SpringerOpen Newsletter

Receive periodic news and updates relating to SpringerOpen.

Open Access Research

Adverse event reporting in adult intensive care units and the impact of a multifaceted intervention on drug-related adverse events

Alberto Pagnamenta1, Giovanni Rabito2, Alessandra Arosio2, Andreas Perren1, Roberto Malacrida1, Fabrizio Barazzoni3 and Guido Domenighetti1*

Author Affiliations

1 Department of Intensive Care Medicine of the Ente Ospedaliero Cantonale (EOC), Intensive Care Units of the Regional Hospitals Mendrisio, Locarno, Bellinzona and Lugano, Switzerland

2 Division of Quality Improvement and Risk Management, Regional Hospital Locarno, Bellinzona, Switzerland

3 Medical Area Unit of the EOC, Bellinzona, Switzerland

For all author emails, please log on.

Annals of Intensive Care 2012, 2:47  doi:10.1186/2110-5820-2-47

The electronic version of this article is the complete one and can be found online at: http://www.annalsofintensivecare.com/content/2/1/47


Received:3 April 2012
Accepted:30 October 2012
Published:22 November 2012

© 2012 Pagnamenta et al.; licensee Springer.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Adverse events (AEs) frequently occur in intensive care units (ICUs) and affect negatively patient outcomes. Targeted improvement strategies for patient safety are difficult to evaluate because of the intrinsic limitations of reporting crude AE rates. Single interventions influence positively the quality of care, but a multifaceted approach has been tested only in selected cases. The present study was designed to evaluate the rate, types, and contributing factors of emerging AEs and test the hypothesis that a multifaceted intervention on medication might reduce drug-related AEs.

Methods

This is a prospective, multicenter, before-and-after study of adult patients admitted to four ICUs during a 24-month period. Voluntary, anonymous, self-reporting of AEs was performed using a detailed, locally designed questionnaire. The temporal impact of a multifaceted implementation strategy to reduce drug-related AEs was evaluated using the risk-index scores methodology.

Results

A total of 2,047 AEs were reported (32 events per 100 ICU patient admissions and 117.4 events per 1,000 ICU patient days) from 6,404 patients, totaling 17,434 patient days. Nurses submitted the majority of questionnaires (n = 1,781, 87%). AEs were eye-witnessed in 49% (n = 1,003) of cases and occurred preferentially during an elective procedure (n = 1,597, 78%) and on morning shifts (n = 1,003, 49%), with a peak rate occurring around 10 a.m. Drug-related AEs were the most prevalent (n = 984, 48%), mainly as a consequence of incorrect prescriptions. Poor communication among caregivers (n = 776) and noncompliance with internal guidelines (n = 525) were the most prevalent contributing factors for AE occurrence. The majority of AEs (n = 1155, 56.4%) was associated with minimal, temporary harm. Risk-index scores for drug-related AEs decreased from 10.01 ± 2.7 to 8.72 ± 3.52 (absolute risk difference 1.29; 95% confidence interval, 0.88-1.7; p < 0.01) following the introduction of the intervention.

Conclusions

AEs occurred in the ICU with a typical diurnal frequency distribution. Medication-related AEs were the most prevalent. By applying the risk-index scores methodology, we were able to demonstrate that our multifaceted implementation strategy focused on medication-related adverse events allowed to decrease drug related incidents.

Keywords:
Adverse events; Medical errors; Patient safety; Quality improvement; Intensive care; Reliability

Background

At the beginning of this century, the Institute of Medicine published landmark reports on the poor reliability of health care organizations, estimating hospital-based medical errors to be the eighth leading cause of death in the United States [1,2]. Further publications from other countries confirmed that deficiencies in quality of care and in patient safety were not confined to the United States [3-5]. As a consequence, several health care institutions implemented efforts to improve safety at various levels [6,7].

A highly monitored environment and a higher manpower availability in the intensive care unit (ICU) compared with the hospital ward would theoretically imply that the ICU should be the safest and most reliable place within the hospital. The ICU, however, represents a high-risk area for adverse events (AEs) that could occur due to the complexity of care, the large number of interventions performed, and the patients’ fragile medical conditions [8-11]. The occurrence of AEs affects survival rates significantly and independently [12,13]. The high level of monitoring and documentation within the ICU should increase the probability to detect and report AEs. Recognizing AEs, accepting their occurrence, and disclosing them—the later being a crucial step to improve patient safety—are the most important steps to prevent AEs [14].

Presently, no reference method exists to identify AEs [15-17]. Despite several limitations, the system of voluntary reporting of AEs during hospital stay remains a valuable tool to help ICUs to identify safety hazards and learn from deficits, but it does not allow evaluating the progress of improved patient safety [11,15]. Various factors hinder the quantification of the improvement that should follow the implementation of a strategy according to the evolution of the crude rate of AE reports. The risk-index score methodology is an attractive tool to evaluate performance because it is independent of rate-based measures [18], but it has not yet been introduced into the ICU.

Medication-related AEs have been reported to be among the most prevalent types of AE in the ICU [8-11]. Single interventions, such as electronic prescription or involvement of a pharmacist in the direct care of ICU patients, have been reported to affect positively the AE occurrence; a prospectively evaluated, multifaceted implementation program has so far been evaluated only for two selected medications [19]. This investigation therefore aimed at describing the frequency, characteristics, and contributing factors of AEs that emerged during a 24-month period in the ICUs of a large non-University, public, multicenter, teaching hospital-network. We exploited a self-reporting strategy during the hospital stay and tested the hypothesis that a multifaceted intervention focused on medication errors decreased the risk-index scores for drug-related AEs.

Methods

Study design

This was a before-and-after study design. The study first evaluated prospectively the incidence, nature, and contributing factors of emerging AEs in the ICU adopting a detailed, locally developed, self-reporting questionnaire. Thereafter, we tested whether a multifaceted strategy (see later for details) targeted on drug-related AEs would decrease the risk-index scores for drug-related AEs (Figure 1).

thumbnailFigure 1. Study design. Staff training in adverse events (AE) reporting during 2 months before the pre-implementation period (May 1, 2004 to April 30, 2005). The multifaceted intervention on drug-related AEs was arranged 6 months before its definitive introduction into clinical practice (May 1, 2005). The three structured meetings with the caring staff took place during the same week in the four ICUs.

Three structured meetings with the care staff during the study period evaluated a specific strategy to increase the reporting rate. This strategy consisted of focused interviews and meetings with the caregivers to address their perspectives on AE reporting in the ICU, identify key barriers to reporting, and propose solutions to increase reporting. These meetings took place during the same week in the four ICUs (Figure 1).

Study setting

This investigation was performed in four multidisciplinary ICUs [Mendrisio (6 beds), Locarno (7 beds), Bellinzona (8 beds), and Lugano (12 beds); total number of beds: 33] in non-University teaching hospitals in Southern Switzerland. These hospitals with approximately 1,000 beds are integrated in a multisite public hospital as a network (Ente Ospedaliero Cantonale: EOC) providing care to patients in Southern Switzerland and serving a population of 350,000 inhabitants. Because the four institutions have no subunits or intermediate care units, less critically ill patients are admitted to the ICUs, which provide only adult intensive care for medical, surgical, and trauma patients. All ICUs have a closed attending model with hospital-based intensivists who assume the primary responsibility of the patients. At least a junior medical staff is present in each unit and the nursing allocation has a 1:2 ratio. The ICUs are organized with three nurse shifts, rotating at 7:00 a.m., 03:00 p.m., and 11:00 p.m. as well as two or three physician shifts per day.

Study population and participants

This study included all patients admitted to the ICUs during a 24-month period from May 2004 to April 2006. Patients were followed up until discharge from the ICU or death. Participants included all healthcare workers who were directly involved in or witnessed an AE and reported it. This study was approved by the regional Ethics Committee, which waived the requirement for patient informed consent due to the anonymous nature of all acquired data.

Data collection

An AE was defined as any unintentional event due to healthcare management, such as human error, organizational failure, or equipment failure that caused or could have caused patient harm. This definition does not necessarily require a prolongation of hospitalization or patient disability nor implies any assumption about the severity of the AE. The AE reporting questionnaire was developed by the study investigators and was first tested in a 2-week pilot phase. Following feedback from the care staff, the clarity and completeness of the questionnaire was improved and the final version was used unaltered during the whole study period (English translation: see Additional file 1). We preferred to develop our own questionnaire to address better our local medical practices. Before the study start, all caregivers in each ICU attended an extensive educational program that provided incentives for AEs reporting to minimize measurement bias. This study was coordinated locally by the chief nurse and the intensivist in charge of each ICU. A study nurse coordinated this trial to help the caregivers maintain high levels of motivation, to provide regular feedback to the staff, as well as to enter the data of the paper-based AE questionnaires into an electronic database for subsequent data analysis.

Additional file 1. Intensive care adverse events (AE) monitoring: English translation of the original AE reporting questionnaire.

Format: PDF Size: 34KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

All AEs were collected continuously. AE reporting was spontaneous, nonpunitive, and confidential as patient and reporter data remained anonymous. Data fields on the questionnaire included professional position and role of reporter, patient characteristics (leading diagnosis, simplified acute physiology score (SAPS II), and the nine equivalents of nursing manpower use score (NEMS) [20]), AE circumstances (when and where the AE occurred), selected AE categories (medication, indwelling lines, communication, airway, equipment, other), and contributing factors (human, team-related, or system-related; multiple selections possible per report). Drug-related AEs were further characterized as incorrect prescription, inconsistency between prescription and administration, wrong time dosage, incorrect administration technique, mistaken time of administration, wrong initial dosage, wrong preparation, or other. Each patient’s basic demographic characteristics were routinely recorded in patient’s medical chart but omitted in the AE questionnaire to maximize anonymity and confidentiality. AEs were classified on a nine-point Likert scale based on their potential to harm (1: no harm; 2: no detectable harm; 3: minimal temporary harm; 4: minimal permanent harm; 5: moderate temporary harm; 6: moderate permanent harm; 7: severe temporary harm; 8: severe permanent harm; 9: death). The likelihood of recurrence of AEs was classified on a five-point Likert scale (1: rare; 2: unlikely; 3: possible; 4: likely; 5: almost certain). The chief nurse and the attending physician reviewed locally each AE questionnaire at weekly intervals to verify data completeness and consistency, to minimize duplicate reporting and to achieve a consensus assessment, reviewing the patient’s medical chart if necessary. In case of disagreement, the study-nurse was involved in the adjudication process.

Multifaceted implementation strategy for drug-related AEs

Considering the high prevalence of medication errors during the first 12 months of this trial as well as reported in other studies [8-11,19], the following medication-related strategies were introduced for the second 12 months: 1) basic electronic prescription without clinical decision support tools; 2) standardized labeling of continuously infused medications; 3) identical models of perfusors and infusion pumps; 4) partial involvement of a pharmacist in the direct care of ICU patients (part-time pharmacist who checked all electronic prescriptions for drug-dosing adjustments for hepatic and/or renal dysfunction, drug interactions, and compatibility checking of the patient’s intravenous medications). These four measures were easy to implement in first line as drug-related AEs represent a multistep problem and require different approaches. The optimal preparation of the caring staff required only a 6-month run-in period for the measures to be introduced before definitely becoming part of the clinical practice (Figure 1). Before the new electronic prescribing process, drug prescription was handwritten, in most cases by a trainee after the clinical daily round. The electronic prescription took place during the multidisciplinary clinical round, thus allowing direct check of prescriptions, better communication between the different caregivers and integration of treatment plans.

Data analysis

Paper-based data were first entered into a Microsoft Excel database and then exported to the SPSS® package (SPSS Version 18, Chicago, IL). Reporting rates were calculated as number of events reported per 100 ICU-patient admissions and 1,000 ICU-patient days. The distribution of daily AEs was evaluated using an analysis of variance. For risk assessment, a risk matrix was adopted in accordance with the guidelines of the National Patient Safety Agency of the UK [18]. A risk-index score was obtained by multiplying the potential harm of a given AE by its likelihood of recurrence and graded as follows: 1–3: low risk; 4–6: moderate risk; 7–15: high risk; 16–45: extreme risk. Risk-index scores are presented as mean ± standard deviation (SD) after testing for normality of the sample distribution using the Kolmogorov-Smirnov test. The risk-index score analysis was performed on the most prevalent AE categories (medication, indwelling lines, communication/planning, and airway-related). The mean risk-index values of the first and the subsequent 12 months (before and after the introduction of the multifaceted intervention) were compared using the Student’s t test, and the absolute risk differences are presented with the corresponding 95% confidence intervals (CIs). All tests were two-sided, and p values <0.05 were considered statistically significant. The crude monthly AE reporting rate was evaluated using a general linear regression model with repeated measures.

Results

During the study period, 6,404 adult patients were admitted to our ICUs, representing 17,434 patient days (Table 1).

Table 1. Patient characteristics

AE reporting frequency and characteristics

A total of 2,047 AEs were recorded corresponding to 32 events per 100 ICU-patient admissions and for 117.4 events per 1,000 ICU-patient days (Table 2). The SAPS II score was recorded in 27% of AE (n = 553) questionnaires. Most AEs occurred during elective procedures (n = 1,597, 78%) and the majority of AEs took place within the ICU (n = 1,862, 91%). AE reporting was equally distributed between working days and weekends (mean AE ± SD: working days 2.84 ± 1.11 and weekends 2.69 ± 1.28; p = 0.51); 49.3% (n = 1,009) of the reported AEs occurred during the morning shift, 30.3% (n = 620) during the evening shift, and 20.4% (n = 418) during the night shift. Most AEs occurred between 08:00 and 12:00 a.m. with a peak around 10:00 am (Figure 2). The most frequent drug-related AEs were associated with incorrect prescriptions (Table 3).

Table 2. Adverse events characteristics

thumbnailFigure 2. Distribution of adverse events (AEs) during the day. Most reported AEs occurred between 08:00 and 12:00 a.m., with a peak around 10:00 am. Horizontal dashed line (at 1.8145 AEs/hour) indicates the limit of statistical significant among comparisons of means AEs per hour. SEM, standard error of the mean.

Table 3. Characteristics of drug-related adverse events

Contributing factors of reported AEs

The contributing factors associated with AEs were further classified as human, team, or system factors. Among human factors, noncompliance with internal guidelines, policies, or checklists (n = 525) were the most prevalent categories, followed by wrong procedure planning (n = 481), attention deficit without sleep deprivation (n = 464), and elevated workload (n = 433). Among team-related factors communication failure between nurses and physicians was evident in 420 cases, communication failure within the nursing staff in 356 cases. Time pressure due to organizational problems and insufficient staffing were the most prevalent categories (217 and 183 reports, respectively) of the system-related factors.

Description of harm

On the nine-point scale of potential harm, 1,155 AEs (56.4%) were classified as level 3 (minimal temporary harm), 302 (14.8%) as level 4 (minimal permanent harm), and 265 (12.9%) as level 2 (no detectable harm). No AEs leading to the patient death were recorded, but five AEs (0.2%) were related to severe permanent harm (level 8).

Effects of the multifaceted intervention

The mean risk-index score for medication errors improved from the first 12-month period to the second 12-month period from 10.01 ± 2.7 to 8.72 ± 3.52 (absolute risk difference 1.29; 95% CI 0.88-1.7; p < 0.01); the mean risk-index score for communication improved as well. Contrarily, the mean risk-index scores for airway-related and for indwelling lines-related AEs did not change over time (Table 4).

Table 4. Risk-index score analysis as a function of time: before (first 12-month period) and after (last 12-month period) the introduction of a multifaceted strategy targeting medication

Effects of the structured meetings

AE reporting increased in the months following each structured meeting with the care staff (Figure 3).

thumbnailFigure 3. Mean monthly reporting rates of adverse events (AEs) during the entire study period (24 months). Vertical dashed lines indicate the occurrence of structured meetings with the care staff. After each meeting, an increase in AE reporting occurred.

Discussion

Concurring with many previous reports [8-11,21,22], the present study confirmed that AEs are frequently experienced by ICU patients. Our study showed clearly that risk-index scores for drug-related AEs decreased as a consequence of the multifaceted intervention strategy on medication that we applied. Despite the intrinsic limitations of self-reporting methodologies for evaluating performance, we think that a risk-index score analysis represents a useful tool to evaluate targeted improvement strategies.

AE incidence rates are difficult to compare among studies, in part because of different AE reporting strategies. Despite implementation of a single methodology, the Sentinel Events Evaluation (SEE) 1 study reported medication errors by unit staff at a rate of 10.5 per 100 patient days [23], whereas a value of 74.5 per 100 patient days was documented in the SEE 2 study [24]. This difference is probably related to the fact that the SEE 1 study captured errors in five selected AE categories, whereas the SEE 2 study focused on medication errors only.

As documented in other similar studies, our reporting rates differed among healthcare worker groups [10,11]. ICU nurses reported most of the AEs reflecting the different numbers and types of activities performed by distinct caregiver groups. Contrary to popular belief, most of the AEs in our study occurred during elective procedures, as in the multicenter SEE 2 study [24]. Elective procedures may be considerably improved by adopting educational interventions and protocol implementation. Single-center and multicenter studies have exhibited similar diurnal distributions of AEs, with a peak in morning caregiver activities [8,17]. This observation highlights the need to recognize these variations throughout the day and to identify the corresponding opportunities for error, which will promote better planning for and allocation of resources to decrease risk.

The characteristics of the AEs in our study are consistent with previous reports that suggest a common pattern of AEs in the ICU [8-11,23]. Drug-related AEs are the most common; these errors are frequently detected and reported because medication administration is a multistep procedure that requires correct prescription and administration of the right drug to the right patient at the right dose via the right route at the right time [21,22,24]. Our most frequent medication-based AEs were related to incorrect prescriptions. The practice of handwritten and sometimes only verbally communicated medical prescription in our ICUs may partly explain this finding. Furthermore, the prescription was annotated by a trainee in most of the AE cases. This calls for a better supervision when prescriptions are ordered verbally. As previously reported [21,22,24], many of these medication-related AEs can potentially be prevented using adequate information and communication technologies, which in turn, however, may introduce new hazards requiring further investigation [25]. In a stepwise multivariate logistic regression analysis, Valentin et al. found that physician electronic prescribing was associated with reduced odds for the occurrence of a medication-related AE [24]. A basic computerized prescribing tool can be implemented in combination with clinical decision support for correct drug dosing, a drug/laboratory value check, and a drug/drug interaction check. Finally, the involvement of a pharmacist in the direct care of ICU patients has been shown not only to positively impact patient outcome, but also to reduce costs [26,27]. Noncompliance with internal guidelines, policies, and checklists was frequently reported in our study as a personal-related contributing factor for AEs, underlying the urgent need to improve continuous education of our ICU personnel. Poor communication among the care staff has been repeatedly identified as a contributing factor to many AEs [28,29] and also has been observed in our study. Possible solutions may be achieved by improving interdisciplinary communication during bedside rounds in the ICUs, which was previously associated with reduced AE rates [30]. Furthermore, communication skills training is needed to create a favorable atmosphere of trust and respect allowing open interaction as well as creating a positive unit climate, which has recently been shown to maximize patient safety [31].

Our multifaceted, medication-focused intervention was associated with reduced risk-index scores for drug-related AEs, although we cannot ultimately confirm any causal relationship despite the consistency, plausibility, and temporality. Moreover, the unchanged risk-index scores for airway-related AEs and indwelling lines-related AEs supports the hypothesis that our multifaceted intervention plan positively affected medication-related AE risk-index scores. Because we did not introduce any specific strategy for mitigating communication-related AEs, we assume that the new electronic prescribing process affected indirectly the observed improved risk-index score in this category. Computerized physician order entry performed during the multidisciplinary clinical round allowed a better communication and integration of treatment plans between caregivers. In a cluster-randomized, crossover study, Garrouste-Ogeas et al. demonstrated that multifaceted safety programs decreased insulin administration errors [19]. Contrary to our study, their trial focused on two selected medications (insulin and anticoagulant) at two selected stages (prescription and administration). Furthermore, AE reporting resulted from a combination of an external observer with medical chart review and significant Hawthorne effects (bias following a change in behavior under observation) were observed by the authors. Compared with our study, the cluster-randomized, crossover design used by Garrouste-Ogeas et al. has obviously several strengths (no bias arising from regression to the mean and no historical bias).

We also have demonstrated in agreement with a previous report [11] that AE reporting increased after structured meetings with the care staff that addressed the staff’s perspectives on AE reporting. Our improved post-meeting reporting rate decreased in the following months, suggesting that regular meetings at closer intervals are needed to maintain a high and constant reporting rate.

This trial has several limitations. First, basic patient demographic characteristics were not mentioned in the AE report to maximize anonymity and confidentiality. As a consequence, we did not document the number of patients suffering an AE, but only the total number of events assigned to different categories. This limitation precludes the calculation of odds ratios and a more sophisticated statistical analysis. Second, the survey was performed in four multidisciplinary ICUs of non-University teaching hospitals using a locally developed AE questionnaire. Therefore, our results may not be generalizable to other ICUs with different characteristics (patient types, severity of illness, staffing pattern). Third, the nurses reported most of the AEs, inducing a possible reporting bias. However, this observation is consistent with previous reports [10,11], reflecting the larger time specific caregivers spend in direct patient care. A before-and-after study design such as ours that evaluates a multifaceted implementation strategy has the potential risk of historical bias and other possible external confounders [32]. These limitations could be avoided with a randomized study design, but this was impractical in our ICUs. Finally, our study focused on AE reporting rather than on patient safety. In this context, it is important to remember that AE reporting is the first step in safety-improvement strategies [15]; the SEE 2 study revealed that an existing critical incident reporting system was an independent predictor for a decreased risk of parenteral medication-based AEs at the administration stage [24].

The strengths of our study include the multicenter design, the long study period, the prospective self-reporting by caregivers during hospital stay, the utilization of a detailed questionnaire allowing better characterization of AE occurrence, and the use of the risk-index score methodology. This methodology may enable monitoring of the results of a specific implementation plan. Reporting of the crude AE rates before and after an implementation cannot be used to evaluate progress in patient safety for several reasons, including nonrandom sample reporting from an unknown probability distribution, a reporting bias of unknown magnitude and direction as well as an unknown at-risk population [14]. A risk-index score as a function of time may represent a useful tool for the assessment of targeted improvement interventions, given its use of a non-rate-based measure. Despite defining consequences as objectively as possible, it is inevitable that scoring the consequences of some risks will involve a degree of subjectivity [18]. It is important that effective, practical training and relevant examples form a part of the implementation of any risk-assessment system to maximize scoring consistency across the organization.

As in other investigations of AEs in the ICU, we had no “gold-standard” method to detect AEs. The use of external observers [8,19,21] may be considered a reference method for capturing AEs, but this strategy appears to consume a large number of resources and suffers from the Hawthorne effect. The AE self-reporting method provides a detailed description of the AE and identifies a large number of preventable incidents, but it has the risk of selection bias, underreporting and some degree of Hawthorne effect, whereas retrospective medical chart review provides less contextual information for an AE and identifies fewer preventable incidents. A combination of different data-gathering methods is likely to be optimal. However, it is usually accepted that it is preferable to reduce the quantity but not the quality of data collection [32].

Conclusions

This study once again demonstrates that adverse events are common in ICU and drug-related AE is the most prevalent. Errors have a typical diurnal frequency distribution calling for a corresponding human resources allocation. We identified several potential prevention strategies that could be relatively easily introduced in clinical practice to improve patient safety. By applying the risk-index scores methodology, we were able to demonstrate that our multifaceted implementation strategy focused on medication-related adverse events, allowed to decrease drug-related incidents.

Competing interests

The authors declare that they have no competing interests.

Authors’ contribution

GD conceived the study. AP, AA, APe, RM, FB, and GD participated in the design of the study. All authors participated in the acquisition of data. AP, AA, GR, and GD performed the statistical analysis. AP, GR, APe, and GD drafted the manuscript. All authors revised the manuscript for important intellectual content and have given final approval for publication of this version. All authors read and approved the final manuscript.

Acknowledgments

We are grateful to the caregivers in our ICUs, especially the chief nurses (Lilli Bögli, Germano Penati, Cristina Sommacal, and Ines Sperandio) for their essential contribution to the success of this study. We thank Yvonne Willems-Cavalli, RM, MSc, and the general direction of the EOC for continuous support during the study period. We acknowledge Costanzo Limoni, MSc, for his advice in the statistical analysis. The authors thank Liliane Petrini-Klieber, Ph.D., for critically reviewing the manuscript. This study was supported in part by a grant from the EOC, Bellinzona, Switzerland.

References

  1. Kohn L, Corrigan K, Donaldson M: To Err is human-building a safer health system, Committee on quality of health care in America. Institute of Medicine. Washington: National Academy Press; 2000. OpenURL

  2. Institute of Medicine: Crossing the quality chasm: a new health system for the 21st century. Washington, DC: National Academy Press; 2001. OpenURL

  3. Wilson RM, Runciman WB, Gibberd RW, Harrison B: The quality in Australian care study.

    Med J Aust 1995, 163:458-471. PubMed Abstract OpenURL

  4. Vincent C, Neale G, Woloshynowych M: Adverse events in British hospitals: preliminary retrospective record review.

    BMJ 2001, 322:517-519. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  5. Sheldon T: Dutch study shows that 40% of adverse incidents in hospital are avoidable.

    BMJ 2007, 334:925. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  6. Leape LL, Berwick DM: Five years after to err is human. What have we learned?

    JAMA 2005, 293:2384-2390. PubMed Abstract | Publisher Full Text OpenURL

  7. The leapfrog group hospital patient safety survey.

    http://www.leapfroggroup.org webcite

    OpenURL

  8. Donchin Y, Gopher D, Olin M, et al.: A look into the nature and causes of human errors in the intensive care unit.

    Crit Care Med 1995, 23:294-300. PubMed Abstract | Publisher Full Text OpenURL

  9. Bracco D, Favre JB, Bissonnette B, et al.: Human errors in a multidisciplinary intensive care unit: a 1-year prospective study.

    Intensive Care Med 2001, 27:137-145. PubMed Abstract | Publisher Full Text OpenURL

  10. Rothschild JM, Landrigan CP, Cronin JW, et al.: The critical care safety study: the incidence and nature of adverse events and serious medical error in intensive care.

    Crit Care Med 2005, 33:1694-1700. PubMed Abstract | Publisher Full Text OpenURL

  11. Harris CB, Krauss MJ, Coopersmith CM, et al.: Patient safety event reporting in critical care: a study of three intensive care units.

    Crit Care Med 2007, 35:1068-1076. PubMed Abstract | Publisher Full Text OpenURL

  12. Garrouste Orgeas M, Timsit JF, Soufir L, et al.: Impact of adverse events on outcome in intensive care unit patients.

    Crit Care Med 2008, 36:2041-2047. PubMed Abstract | Publisher Full Text OpenURL

  13. Garrouste Orgeas M, Timsit JF, Vesin A, et al.: Selected medical errors in the intensive care unit. Results of the IATROREF study: part I and II.

    Am J Respir Crit Care Med 2010, 181:134-142. PubMed Abstract | Publisher Full Text OpenURL

  14. Leape LL: Reporting of adverse events.

    N Engl J Med 2002, 20:1633-1638. OpenURL

  15. Berenholtz SM, Pustavoitau A, Schwartz SJ, Pronovost PJ: How safe is my intensive care unit? Methods for monitoring and measurement.

    Curr Opin Crit Care Med 2007, 13:703-708. Publisher Full Text OpenURL

  16. Beckmann U, Bohringer C, Carless R, et al.: Evaluation of two methods for quality improvement in intensive care: facilitated incident monitoring and retrospective medical chart review.

    Crit Care Med 2003, 31:1006-1011. PubMed Abstract | Publisher Full Text OpenURL

  17. Michel P, Quenon JL, de Sarasqueta AM, Scemana O: Comparison of three methods for estimating rates of adverse events and rates of preventable adverse events in acute care hospitals.

    BMJ 2004, 228:1-5. OpenURL

  18. A risk matrix for risk managers.

    http://www.nrls.npsa.nhs.uk/resources/?EntryId45=59813 webcite

    OpenURL

  19. Garrouste-Orgeas M, Soufir L, Tabah A, et al.: A multifaceted program for improving quality of care in intensive care units: IATROREF study.

    Crit Care Med 2012, 40:468-476. PubMed Abstract | Publisher Full Text OpenURL

  20. Reis Miranda D, Moreno R, Iapachino G: Nine equivalent of nursing manpower use score.

    Intensive Care Med 1997, 23:760-765. PubMed Abstract | Publisher Full Text OpenURL

  21. Van den Bemt P, Fijn R, van der Voort P, et al.: Frequency and determinants of drug administration errors in the intensive care unit.

    Crit Care Med 2002, 30:846-850. PubMed Abstract | Publisher Full Text OpenURL

  22. Herout PM, Erstad BL: Medication errors involving continuously infused medications in a surgical intensive care unit.

    Crit Care Med 2004, 32:428-432. PubMed Abstract | Publisher Full Text OpenURL

  23. Valentin A, Capuzzo M, Guidet B, et al.: Patient safety in intensive care: results from the multinational Sentinel Events Evaluation (SEE) study.

    Intensive Care Med 2006, 32:1591-1598. PubMed Abstract | Publisher Full Text OpenURL

  24. Valentin A, Capuzzo M, Guidet B, et al.: Errors in administration of parenteral drugs in intensive care units: multinational prospective study.

    BMJ 2009, 338:1-8. Publisher Full Text OpenURL

  25. Ammenwerth E, Schell-Inderst P, Machan C, et al.: The effect of electronic prescribing on medication errors and adverse events: a systematic review.

    J Am Med Inform Assoc 2008, 15:585-600. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  26. Kane SL, Weber RJ, Dasta JF: The impact of critical care pharmacists on enhancing patient outcomes.

    Intensive Care Med 2003, 29:691-698. PubMed Abstract | Publisher Full Text OpenURL

  27. MacLaren R, Bond CA, Martin SJ, Fike D: Clinical and economic outcome of involving pharmacists in the direct care of critically ill patients with infections.

    Crit Care Med 2008, 36:3184-3189. PubMed Abstract | Publisher Full Text OpenURL

  28. Pronovost P, Thompson D, Holzmueller C, et al.: Toward learning from patient safety reporting systems.

    J Crit Care Med 2006, 21:305-315. OpenURL

  29. Reader TW, Flin R, Cuthbertson BH: Communication skills and error in the intensive care unit.

    Curr Opin Crit Care 2007, 13:732-737. PubMed Abstract | Publisher Full Text OpenURL

  30. Jain M, Miller L, Belt D, et al.: Decline in ICU adverse events, nosocomial infections and cost through a quality improvement initiative focusing on teamwork and culture change.

    Qual Saf Healthcare 2006, 15:235-239. Publisher Full Text OpenURL

  31. Zohar D, Livne Y, Tenne-Gazit O, Admi H, Donchin Y: Healthcare climate: a framework for measuring and improving patient safety.

    Crit Care Med 2007, 35:1312-1317. PubMed Abstract | Publisher Full Text OpenURL

  32. Pronovost PJ, Goeschel CA, Marsteller JA, et al.: Framework for patient safety research and improvement.

    Circulation 2009, 119:330-337. PubMed Abstract | Publisher Full Text OpenURL