Skip to main content

Prospective assessment of a score for assessing basic critical-care transthoracic echocardiography skills in ventilated critically ill patients

Abstract

Background

We studied a score for assessing basic transthoracic echocardiography (TTE) skills exhibited by residents who examined critically ill patients receiving mechanical ventilation.

Methods

We conducted a prospective study in the 16 residents who worked in our medical-surgical ICU between 1 May 2008 and 1 November 2009. The residents received theoretical teaching (two hours) then performed supervised TTEs during their six-month rotation. Their basic TTE skills in mechanically ventilated patients were evaluated after one (M1), three (M3), and six (M6) months by two experts, who used a scoring system devised for the study. After scoring, residents gave their hemodynamic diagnosis and suggested a treatment.

Results

The 4 residents with previous TTE skills obtained a significantly higher total score than did the 12 novices at M1 (18 (16 to 19) versus 13 (10 to 15), respectively, P = 0.03). In the novices, the total score increased significantly during training (M1, 13 (10 to 14); M3, 15 (12 to 16); and M6, 17 (15 to 18); P < 0.001) and correlated significantly with the number of supervised TTEs (r = 0.68, P < 0.0001). In the overall population, agreement with experts regarding the diagnosis and treatment was associated with a significantly higher total score (17 (16 to 18) versus 13 (12 to 16), P = 0.002). A total score ≥ 19/20 points had 100% specificity (95% confidence interval, 79 to 100%) for full agreement with the experts regarding the diagnosis and treatment.

Conclusions

Our results validate the scoring system developed for our study of the assessment of basic critical-care TTE skills in residents.

Background

Echocardiography is increasingly used to evaluate the hemodynamic status of patients in the ICU or operating room. Transthoracic echocardiography (TTE) and transesophageal echocardiography (TEE) provide a broad range of cardiovascular parameters for rapidly understanding the causes and mechanisms of circulatory failure [18]. In many studies, echocardiography was found to contribute substantially to the goal-oriented treatment of circulatory failure [914]. Both TTE and TEE used as tools for hemodynamic management benefited therapeutic decisions in patients receiving intensive care [1521] or undergoing surgery [2225]. Echocardiography is therefore among the recommended tools for managing patients with shock [26].

The main limitation of echocardiography is that an experienced operator is required. Formal teaching programs are a crucial prerequisite to the development of ultrasound techniques in critical care [27, 28]. Experts agree that basic critical-care echocardiography skills must be taught to all intensivists [29]. Several studies have established that non-cardiologist intensivists can acquire these basic skills after a short period of training [911, 3035].

Determining whether trainees have acquired the necessary echocardiography skills is a major issue. There is no consensus about the number of supervised echocardiograms a trainee must perform to become sufficiently skilled [29]. A standard scoring system with a cutoff value indicating that basic skills have been acquired would be helpful [36]. Such a scoring system has been validated for TEE in critically ill patients [37]. A recent study that used this score in ICU intensivists showed that 31 supervised TEEs in mechanically ventilated ICU patients were needed to reliably achieve competence in advanced critical-care TEE [38]. To our knowledge, these two studies are the only ones to use such a standard scoring system. However, both studies focused on TEE, although TTE is often the first-line ultrasound method used for hemodynamic assessment [36]. Moreover, neither study evaluated whether higher scores predicted better treatment decisions by the trainees. Finally, the scoring system used in these studies includes quantitative measurements, whereas basic critical-care echocardiography involves only semi-quantitative measurements [29].

Here, our objective was to validate a score for assessing basic TTE skills in trainees examining mechanically ventilated ICU patients. We also identified the score cutoff above which trainees made appropriate decisions regarding hemodynamic management.

Methods

Study protocol

We conducted a prospective observational study in the 15-bed medical-surgical ICU of a general hospital between 1 May 2008 and 1 November 2009. The protocol for standard management of circulatory failure was the protocol used routinely in our ICU. Standard management involved routine TTE at circulatory failure onset and as needed thereafter. In particular, no other devices are used in our ICU to assess hemodynamic status of the patients. No changes in the standard management of circulatory failure occurred in the ICU over the study period. Therefore, according to French law on medical research, informed consent from the patients or next of kin was not required for this observational study.

Residents

We included the 16 residents who worked in the ICU during the study period. Their specialties were anesthesiology (n = 6), cardiology (n = 2), emergency medicine (n = 4), and other (n = 4). They had previously completed 5 ± 2 rotations of 6 months each. We divided the residents into two groups: novices (n = 12) had no theoretical and/or practical experience with TTE, whereas skilled residents (n = 4) were cardiologists or certified echocardiographers.

Training

TTE was performed using a Sequoia Siemens C-512 (Siemens Medical Solutions, Malvern, PA, USA) equipped with an Acuson 3V2c probe (Acuson Corp, Mountain View, CA, USA). Training was supervised by two board-certified echocardiographers with at least two years of experience at level-three competence according to the American Society of Echocardiography [39]. All residents received a two-hour theoretical teaching on TTE, designed to show them a selection of typical TTE recordings, during the first week of their six-month rotation in the ICU. Then, residents followed the hands-on training session by performing TTEs repeatedly during their six-month rotation in the ICU under the supervision of one of the two experts, who provided teaching as appropriate. For this purpose, the residents performed all TTEs ordered by the attending physician in mechanically ventilated (volume assist-controlled mode) patients with acute circulatory failure defined as systolic arterial pressure ≤ 90 mmHg despite adequate fluid resuscitation [26], admitted during their six-month rotation in the ICU. Residents could perform several TTE examinations on the same patient during their hands-on training sessions. As far as possible, patients were placed in left lateral decubitus for TTE examination. Otherwise, they were placed in the 30° semi-recumbent position according to the standard management of the patients in our unit. The use of sedatives and neuromuscular blockers was at the discretion of the attending physician. We chose to investigate only mechanically ventilated patients in order to standardize the conditions under which TTE was performed.

Evaluation of the residents and scoring system

After one (M1), three (M3), and six (M6) months, the residents were evaluated during a TTE examination involving the acquisition of apical, subcostal, and parasternal views. Patients with poor echogenicity during TTE, as assessed by the experts, were not considered for the evaluation. The TTE used for the evaluation was performed in a patient who was not among the resident’s patients and on whom the residents had never previously performed TTE examination during their hands-on training sessions. Nevertheless, the resident could have access to all patients’ medical records at any time.

At each study time point, the residents were evaluated by both experts using the scoring system detailed in Table 1. The echocardiographic key-findings the trainees should be able to identify consisted of a real time evaluation. Then, the residents gave their hemodynamic diagnosis and suggested a treatment. Based on their TTE examination and on the data in the patient’s record, residents had to choose among the following hemodynamic diagnoses: hypovolemia in the case of large respiratory variation in inferior vena cava diameter; impaired left ventricular ejection fraction, and/or right ventricular failure in the case of marked dilation of the right ventricle. They also chose among the following therapeutic options, according to the therapeutic algorithm used in our ICU: volume expansion in the case of hypovolemia, vasopressors when there was right ventricular failure or when the acute circulatory failure could neither be attributed to hypovolemia nor to left ventricular dysfunction, and/or inotropes in the case of left ventricular failure. TTE was then repeated by one of the two experts, who assessed the quality of the resident’s TTE and the relevance of the proposed diagnosis and treatment.

Table 1 Scoring system used to evaluate transthoracic echocardiography skills

The scoring system was based upon the one developed previously for TEE [37] but included neither quantitative measurements nor scoring of the diagnosis and treatment. As shown in Table 1, the first part of the score assessed the quality of the TTE views, which was rated as follows: 0, view not obtained; 1, view not considered optimal by the experts; and 2, view considered optimal by the experts. The second part of the score assessed the semi-quantitative measurements needed to answer the clinical questions relevant to basic critical-care echocardiography, as defined when the study was designed [27, 40]: right ventricular dilation (none, moderate, marked), pericardial effusion (none, non-compressive, compressive), respiratory variation in inferior vena cava diameter (none, minimal, large), and visual estimation of the left ventricular ejection fraction (normal, decreased, markedly decreased) (Table 1). We considered that right ventricular dilation was marked when its area was greater than or equal to the area of the left ventricle [41]. We considered that respiratory variation in inferior vena cava diameter was large when there was a marked visual inspiratory increase in inferior vena cava diameter assessed in M-mode. Each semi-quantitative measurement was rated as follows: 0, disagreement with the experts regarding presence of the abnormality; 1, agreement with the experts regarding presence but disagreement regarding severity of the abnormality; and 2, full agreement with the experts. The maximum total score was 20 (Table 1). The hemodynamic diagnosis and suggested treatment together was rated 1 when fully consistent with the experts’ conclusions and as 0 otherwise. TTE scoring and rating of the diagnosis and suggested treatment were performed offline by both experts working together. The time from the beginning of TTE and suggestion of a treatment was recorded.

Statistical analysis

Normality of data distribution was tested using the Kolmogorov-Smirnov normality test. Variables were summarized as percentages, means and standard deviations, or medians (25% to 75% interquartile range (IQR)), as appropriate.

The total score was compared between novices and skilled residents at M1 using the Mann-Whitney U-test. Within the novice group, we compared data at M1, M3, and M6 using Friedman’s test for quantitative variables and the chi-square McNemar’s test for qualitative variables. The correlation between scores and number of supervised TTEs was assessed using a logarithmic regression model.

Residents were separated into two groups based on whether their diagnosis/treatment rating was 1 or 0 (agreement versus disagreement with the experts), and the scores were compared between these groups using the Mann-Whitney U-test. In the overall population of novices and skilled residents, we plotted a receiver-operating characteristics (ROC) curve to identify the score cutoff that predicted full agreement between residents and experts regarding the diagnosis and treatment (rating of 1). The best cutoff was defined as the value providing the highest Youden index. Sensitivity and specificity were computed as means (95% confidence interval (CI)).

P values < 0.05 were considered significant. Statistical tests were performed using Medcalc 11.6.0 software (MedCalc, Mariakerke, Belgium).

Results

Patient characteristics

Each of the 16 residents was evaluated at each of the three time points (M1, M3, and M6), for a total of 48 TTEs, in 48 different patients. Table 2 lists the main patient characteristics and TTE findings. Among the 48 patients, no patients had acute respiratory distress syndrome, 45% were receiving catecholamines and 10% neuromuscular blockers at the time of the TTE evaluation.

Table 2 Characteristics of the 48 transthoracic echocardiography evaluations

Sensitivity of the scoring system to change

The median total number of supervised TTEs performed by each novice was 7 (5 to 10) at M1, 27 (24 to 30) at M3 and 67 (57 to 80) at M6 (Table 3). At M1, the median total score was significantly higher in the group of skilled residents than in the group of novices (18 (16 to 19) versus 13 (10 to 15), respectively, P = 0.03) (Figure 1).

Table 3 Scores for basic critical-care transthoracic echocardiography obtained by the novices at M1, M3, and M6
Figure 1
figure 1

Total transthoracic echocardiography scores at M1 in the 12 novices and 4 skilled residents. The box shows the 25th and 75th percentiles, the line in the box the median, and the whiskers the 5th and 95th percentiles.

In the novices, the total score increased significantly from M1 to M6 (Table 3, Figure 2). The image-quality part of the score increased significantly from M1 to M6, whereas the semi-quantitative measurement part showed a trend toward an increase from M1 to M6 (Table 3). At M6, 83% of novices obtained a total score ≥ 15/20 points.

Figure 2
figure 2

Total transthoracic echocardiography scores at M1, M3, and M6 in the 12 novices. The box shows the 25th and 75th percentiles, the line in the box the median, and the whiskers the 5th and 95th percentiles.

In the novice group, the percentage of optimal TTE views was significantly higher at M6 than at M1 for the inferior vena cava view (75% versus 17%, respectively; P = 0.02) but not for the apical and parasternal views. The number of supervised TTEs correlated significantly with the total TTE score (r = 0.68, P < 0.0001) (Figure 3). The proportion of novices who needed less than 15 minutes to perform TTE and who gave the right diagnosis and treatment increased significantly from M1 to M6 (0% versus 50%, respectively, P = 0.03) (Table 3).

Figure 3
figure 3

Correlation between the total transthoracic echocardiography (TTE) score and the number of supervised TTEs performed by the novices at M1, M3, and M6. N = 33. The line is the correlation line; total scores at M1 are shown as squares, at M3 as circles, and at M6 as triangles.

Ability of the scoring system to predict a correct diagnosis and treatment

In the group of novices, agreement with the experts regarding the diagnosis/treatment improved significantly from M1 to M6 (Table 3). At M6, 10 (83%) of the 12 novices gave the right diagnosis and treatment.

In the overall population of 16 residents, the total TTE score was significantly higher in the subgroup that gave the right diagnosis and treatment compared to the other subgroup (17 (16 to 18) versus 13 (12 to 16), respectively, P = 0.002) (Figure 4).

Figure 4
figure 4

Total transthoracic echocardiography score according to agreement for both the diagnosis and the treatment between residents (N = 16) and experts. The box shows the 25th and 75th percentiles, the line in the box the median, and the whiskers the 5th and 95th percentiles.

The ROC curve plotted using all 48 TTE evaluations in the 16 residents showed that a total score of 14/20 was the best cutoff for predicting full agreement regarding the diagnosis and treatment between residents and experts (area under the ROC curve, 0.78; P < 0.0001 versus 0.50, sensitivity 81% (95% CI, 64 to 93%) and specificity 69% (95% CI, 41 to 89%)) (Additional file 1). A total score ≥ 19/20 points had 100% specificity (95% CI, 79 to 100%) for full agreement with the experts regarding the diagnosis and treatment.

Discussion

In this study, we developed and validated a scoring system for assessing basic critical-care TTE skills in ventilated critically ill patients. A cutoff of 19/20 points had 100% specificity for agreement between residents and experts regarding the diagnosis and treatment.

In recent years, echocardiography has gained widespread acceptance among intensivists for the management of acute circulatory failure [29]. Echocardiography allows a rapid evaluation of the hemodynamic status and is recommended as a diagnostic tool in all patients with persistent circulatory failure despite adequate fluid therapy [26]. There is general agreement that echocardiography to assess patients with circulatory failure can be performed reliably by operators who have a lower skill level than that required in cardiology [29]. This basic skill level can be taught easily, as demonstrated in many studies [911, 20, 3035, 4245]. However, tools are needed to evaluate the skill level achieved by trainees. Experts agree that the skill level does not correlate reliably with the number of supervised echocardiograms [29], as performance could vary with ease of learning, quality of teaching, and specialty of the trainees. Two studies by the same group validated a scoring system for assessing advanced critical-care TEE [37, 38].

We developed a score derived from this previously reported TEE scoring system [37, 38]. Our score was designed for TTE and assessed basic critical-care skills, which are the ability to measure semi-quantitative parameters but not quantitative parameters [46]. Furthermore, in contrast to the advanced TEE score, our basic TTE score did not include the diagnosis and suggested treatment. We were therefore able to correlate score values to agreement between trainees and experts regarding the diagnosis and treatment, as a means of validating the scoring system. We found that a score cutoff of 19/20 had 100% specificity for full agreement between residents and experts regarding the diagnosis and treatment.

We validated our scoring system in three ways. First, at M1, the total score differed significantly between residents with and without prior echocardiography experience. Second, the total score obtained by novices improved significantly over the six-month teaching period. Third, the total score obtained by the overall population of residents was significantly associated with the ability to make the correct diagnosis and to suggest the appropriate treatment, as defined using the opinion of two experts as the reference standard.

Our findings are consistent with previous evidence that acquiring basic critical-care echocardiography skills requires only a limited amount of training [911, 3035]. The theoretical teaching in our study lasted only two hours. By M6, after performing a total of 67 supervised TTEs, 83% of novices obtained scores ≥ 15/20 points and 83% indicated the correct diagnosis and treatment. The time from starting TTE to suggesting a treatment also decreased considerably over the six-month training period. Interestingly, although the novices improved their ability to determine the right diagnosis and treatment between M1 and M6, only the quality of TTE views increased significantly over this period, whereas the improvement in semi-quantitative measurement skills fell short of statistical significance. Therefore, the improved performance regarding diagnosis and treatment is probably ascribable to the accumulation of clinical experience over the six-month rotation rather than to specific improvements in TTE skills. An interesting feature of our study is that supervised TTEs were performed throughout the six-month rotation. This practical approach is easy to use in ICUs that have board-certified echocardiographers on their staff.

The first limitation of our study was that only TTEs in mechanically ventilated patients were considered. This feature improved the standardization of the TTE conditions and increased the time available for teaching and evaluation. However, our score needs to be evaluated in non-intubated patients. Second, the number of residents included in this study was very low. The score cutoffs must therefore be viewed with caution and investigated further to determine whether they are suitable for certification purposes. Third, the theoretical teaching was shorter than the theoretical teaching program currently recommended [29, 46] and the hands- on training period was only six months, which is the duration of resident rotations in France. A longer theoretical teaching and a longer period of training might have improved the evaluation of our scoring system. In addition, a significant improvement in semi-quantitative measurements might have been found over a longer period. Fourth, as residents could have access to all patients’ medical folders, they might be influenced before performing their TTE evaluation and we could not exclude the possibility that the number of TTE examinations needed to obtain a satisfactory score might be underestimated. Fifth, residents performed only a single TTE examination during their evaluation, which therefore might not reflect their true TTE proficiencies because of a bias due to the individual patient’s pathology. Nevertheless, all patients with poor echogenicity, as assessed by the experts, were not considered for TTE evaluation. Sixth, the scoring system did not include the exact items described in a statement by two critical-care societies as appropriate for assessing basic skills [46]. This statement was published after our study was designed. Seventh, we did not previously perform a validation study to first assess the scoring system and we cannot state with certainty that two experts was an adequate number to carry out the TTE evaluations. Nevertheless, in our study, two experts evaluated the trainees to avoid the bias induced by only one expert analysis.

Conclusions

The scoring system that we developed for assessing basic critical-care TTE skills is valid and predicts whether trainees can identify the correct diagnosis and treatment in patients with acute circulatory failure. Further studies are needed to determine whether this score is suitable for critical-care echocardiography certification.

Abbreviations

CI:

confidence interval

IQR:

interquartile range

ROC:

receiver-operating characteristics

TEE:

transesophageal echocardiography

TTE:

transthoracic echocardiography.

References

  1. Vignon P: Hemodynamic assessment of critically ill patients using echocardiography Doppler. Curr Opin Crit Care 2005,11(3):227–234. 10.1097/01.ccx.0000159946.89658.51

    PubMed  Google Scholar 

  2. Slama M, Maizel J: Echocardiographic measurement of ventricular function. Curr Opin Crit Care 2006,12(3):241–248. 10.1097/01.ccx.0000224869.86205.1a

    PubMed  Google Scholar 

  3. Price S, Nicol E, Gibson DG, Evans TW: Echocardiography in the critically ill: current and potential roles. Intensive Care Med 2006,32(1):48–59. 10.1007/s00134-005-2834-7

    CAS  PubMed  Google Scholar 

  4. Beaulieu Y: Bedside echocardiography in the assessment of the critically ill. Crit Care Med 2007,35(5 Suppl):S235-S249.

    PubMed  Google Scholar 

  5. Salem R, Vallee F, Rusca M, Mebazaa A: Hemodynamic monitoring by echocardiography in the ICU: the role of the new echo techniques. Curr Opin Crit Care 2008,14(5):561–568. 10.1097/MCC.0b013e32830e6d81

    PubMed  Google Scholar 

  6. Kaplan A, Mayo PH: Echocardiography performed by the pulmonary/critical care medicine physician. Chest 2009,135(2):529–535. 10.1378/chest.08-0818

    PubMed  Google Scholar 

  7. Poelaert J: Use of ultrasound in the ICU. Best Pract Res Clin Anaesthesiol 2009,23(3):249–261. 10.1016/j.bpa.2009.02.010

    PubMed  Google Scholar 

  8. Field LC, Guldan GJ 3rd: Echocardiography in the Intensive Care Unit. Finley AC: Semin Cardiothorac Vasc Anesth; 2011.

    Google Scholar 

  9. Jensen MB, Sloth E: Echocardiography for cardiopulmonary optimization in the intensive care unit: should we expand its use? Acta Anaesthesiol Scand 2004,48(9):1069–1070. 10.1111/j.1399-6576.2004.00465.x

    CAS  PubMed  Google Scholar 

  10. Vieillard-Baron A, Slama M, Cholley B, Janvier G, Vignon P: Echocardiography in the intensive care unit: from evolution to revolution? Intensive Care Med 2008,34(2):243–249. 10.1007/s00134-007-0923-5

    PubMed  Google Scholar 

  11. Boyd JH, Walley KR: The role of echocardiography in hemodynamic monitoring. Curr Opin Crit Care 2009,15(3):239–243. 10.1097/MCC.0b013e32832b1fd0

    PubMed  Google Scholar 

  12. Noritomi DT, Vieira ML, Mohovic T, Bastos JF, Cordioli RL, Akamine N, Fischer CH: Echocardiography for hemodynamic evaluation in the intensive care unit. Shock 2010,34(Suppl 1):59–62. 10.1097/SHK.0b013e3181e7e8ed

    PubMed  Google Scholar 

  13. Griffee MJ, Merkel MJ, Wei KS: The role of echocardiography in hemodynamic assessment of septic shock. Crit Care Clin 2010,26(2):365–382. Table of contents 10.1016/j.ccc.2010.01.001

    PubMed  Google Scholar 

  14. Ferrada P, Murthi S, Anand RJ, Bochicchio GV, Scalea T: Transthoracic focused rapid echocardiographic examination: real-time evaluation of fluid status in critically ill trauma patients. J Trauma 2011,70(1):56–62. discussion 62–54 10.1097/TA.0b013e318207e6ee

    PubMed  Google Scholar 

  15. Vignon P, Mentec H, Terre S, Gastinne H, Gueret P, Lemaire F: Diagnostic accuracy and therapeutic impact of transthoracic and transesophageal echocardiography in mechanically ventilated patients in the ICU. Chest 1994,106(6):1829–1834. 10.1378/chest.106.6.1829

    CAS  PubMed  Google Scholar 

  16. Poelaert JI, Trouerbach J, De Buyzere M, Everaert J, Colardyn FA: Evaluation of transesophageal echocardiography as a diagnostic and therapeutic aid in a critical care setting. Chest 1995,107(3):774–779. 10.1378/chest.107.3.774

    CAS  PubMed  Google Scholar 

  17. Slama MA, Novara A, Van de Putte P, Diebold B, Safavian A, Safar M, Ossart M, Fagon JY: Diagnostic and therapeutic implications of transesophageal echocardiography in medical ICU patients with unexplained shock, hypoxemia, or suspected endocarditis. Intensive Care Med 1996,22(9):916–922. 10.1007/BF02044116

    CAS  PubMed  Google Scholar 

  18. Jensen MB, Sloth E, Larsen KM, Schmidt MB: Transthoracic echocardiography for cardiopulmonary monitoring in intensive care. Eur J Anaesthesiol 2004,21(9):700–707. 10.1097/00003643-200409000-00006

    CAS  PubMed  Google Scholar 

  19. Huttemann E, Schelenz C, Kara F, Chatzinikolaou K, Reinhart K: The use and safety of transoesophageal echocardiography in the general ICU – a minireview. Acta Anaesthesiol Scand 2004,48(7):827–836. 10.1111/j.0001-5172.2004.00423.x

    CAS  PubMed  Google Scholar 

  20. Croft LB, Duvall WL, Goldman ME: A pilot study of the clinical impact of hand-carried cardiac ultrasound in the medical clinic. Echocardiography 2006,23(6):439–446. 10.1111/j.1540-8175.2006.00240.x

    PubMed  Google Scholar 

  21. Orme RM, Oram MP, McKinstry CE: Impact of echocardiography on patient management in the intensive care unit: an audit of district general hospital practice. Br J Anaesth 2009,102(3):340–344. 10.1093/bja/aen378

    PubMed  Google Scholar 

  22. Kolev N, Brase R, Swanevelder J, Oppizzi M, Riesgo MJ, van der Maaten JM, Abiad MG, Guarracino F, Zimpfer M: The influence of transoesophageal echocardiography on intra-operative decision making. A European multicentre study European Perioperative TOE Research Group. Anaesthesia 1998,53(8):767–773. 10.1046/j.1365-2044.1998.00341.x

    CAS  PubMed  Google Scholar 

  23. Canty DJ, Royse CF: Audit of anaesthetist-performed echocardiography on perioperative management decisions for non-cardiac surgery. Br J Anaesth 2009,103(3):352–358. 10.1093/bja/aep165

    CAS  PubMed  Google Scholar 

  24. Cowie B: Focused cardiovascular ultrasound performed by anesthesiologists in the perioperative period: feasible and alters patient management. J Cardiothorac Vasc Anesth 2009,23(4):450–456. 10.1053/j.jvca.2009.01.018

    PubMed  Google Scholar 

  25. Cowie B: Three years’ experience of focused cardiovascular ultrasound in the peri-operative period. Anaesthesia 2011,66(4):268–273. 10.1111/j.1365-2044.2011.06622.x

    CAS  PubMed  Google Scholar 

  26. Antonelli M, Levy M, Andrews PJ, Chastre J, Hudson LD, Manthous C, Meduri GU, Moreno RP, Putensen C, Stewart T, Torres A: Hemodynamic monitoring in shock and implications for management. International Consensus Conference, Paris, France, 27–28 April 2006. Intensive Care Med 2007,33(4):575–590. 10.1007/s00134-007-0531-4

    PubMed  Google Scholar 

  27. Cholley BP, Vieillard-Baron A, Mebazaa A: Echocardiography in the ICU: time for widespread use! Intensive Care Med 2006,32(1):9–10. 10.1007/s00134-005-2833-8

    PubMed  Google Scholar 

  28. Mayo PH: Training in critical care echocardiography. Ann Intensive Care 2011, 1: 36. 10.1186/2110-5820-1-36

    PubMed Central  PubMed  Google Scholar 

  29. International expert statement on training standards for critical care ultrasonography Intensive Care Med 2011,37(7):1077–1083.

  30. Duvall WL, Croft LB, Goldman ME: Can hand-carried ultrasound devices be extended for use by the noncardiology medical community? Echocardiography 2003,20(5):471–476. 10.1046/j.1540-8175.2003.03070.x

    PubMed  Google Scholar 

  31. Jones AE, Tayal VS, Kline JA: Focused training of emergency medicine residents in goal-directed echocardiography: a prospective study. Acad Emerg Med 2003,10(10):1054–1058. 10.1111/j.1553-2712.2003.tb00574.x

    PubMed  Google Scholar 

  32. Manasia AR, Nagaraj HM, Kodali RB, Croft LB, Oropello JM, Kohli-Seth R, Leibowitz AB, DelGiudice R, Hufanda JF, Benjamin E, Goldman ME: Feasibility and potential clinical utility of goal-directed transthoracic echocardiography performed by noncardiologist intensivists using a small hand-carried device (SonoHeart) in critically ill patients. J Cardiothorac Vasc Anesth 2005,19(2):155–159. 10.1053/j.jvca.2005.01.023

    PubMed  Google Scholar 

  33. Vignon P, Dugard A, Abraham J, Belcour D, Gondran G, Pepino F, Marin B, Francois B, Gastinne H: Focused training for goal-oriented hand-held echocardiography performed by noncardiologist residents in the intensive care unit. Intensive Care Med 2007,33(10):1795–1799. 10.1007/s00134-007-0742-8

    PubMed  Google Scholar 

  34. Melamed R, Sprenkle MD, Ulstad VK, Herzog CA, Leatherman JW: Assessment of left ventricular function by intensivists using hand-held echocardiography. Chest 2009,135(6):1416–1420. 10.1378/chest.08-2440

    PubMed  Google Scholar 

  35. Vignon P, Mucke F, Bellec F, Marin B, Croce J, Brouqui T, Palobart C, Senges P, Truffy C, Wachmann A, Dugard A, Amiel JB: Basic critical care echocardiography: validation of a curriculum dedicated to noncardiologist residents. Crit Care Med 2011,39(4):636–642. 10.1097/CCM.0b013e318206c1e4

    PubMed  Google Scholar 

  36. Poelaert J, Mayo P: Education and evaluation of knowledge and skills in echocardiography: how should we organize? Intensive Care Med 2007,33(10):1684–1686. 10.1007/s00134-007-0802-0

    PubMed  Google Scholar 

  37. Charron C, Prat G, Caille V, Belliard G, Lefevre M, Aegerter P, Boles JM, Jardin F, Vieillard-Baron A: Validation of a skills assessment scoring system for transesophageal echocardiographic monitoring of hemodynamics. Intensive Care Med 2007,33(10):1712–1718. 10.1007/s00134-007-0801-1

    PubMed  Google Scholar 

  38. Charron C, Vignon P, Prat G, Tonnelier A, Aegerter P, Boles JM, Amiel JB, Vieillard-Baron A: Number of supervised studies required to reach competence in advanced critical care transesophageal echocardiography. Intensive Care Med 2013,39(6):1019–1024. 10.1007/s00134-013-2838-7

    PubMed  Google Scholar 

  39. Quinones MA, Douglas PS, Foster E, Gorcsan J 3rd, Lewis JF, Pearlman AS, Rychik J, Salcedo EE, Seward JB, Stevenson JG, Thys DM, Weitz HH, Zoghbi WA, Creager MA, Winters WL Jr, Elnicki M, Hirshfeld JW Jr, Lorell BH, Rodgers GP, Tracy CM: ACC/AHA clinical competence statement on echocardiography: a report of the American College of Cardiology/American Heart Association/American College of Physicians-American Society of Internal Medicine Task Force on clinical competence. J Am Soc Echocardiogr 2003,16(4):379–402. 10.1016/S0894-7317(03)00113-5

    PubMed  Google Scholar 

  40. Beaulieu Y: Specific skill set and goals of focused echocardiography for critical care clinicians. Crit Care Med 2007,35(5 Suppl):S144-S149.

    PubMed  Google Scholar 

  41. Vieillard-Baron A, Prin S, Chergui K, Dubourg O, Jardin F: Echo-Doppler demonstration of acute cor pulmonale at the bedside in the medical intensive care unit. Am J Respir Crit Care Med 2002,166(10):1310–1319. 10.1164/rccm.200202-146CC

    PubMed  Google Scholar 

  42. Bruce CJ, Montgomery SC, Bailey KR, Tajik J, Seward JB: Utility of hand-carried ultrasound devices used by cardiologists with and without significant echocardiographic experience in the cardiology inpatient and outpatient settings. Am J Cardiol 2002,90(11):1273–1275. 10.1016/S0002-9149(02)02853-9

    PubMed  Google Scholar 

  43. DeCara JM, Lang RM, Koch R, Bala R, Penzotti J, Spencer KT: The use of small personal ultrasound devices by internists without formal training in echocardiography. Eur J Echocardiogr 2003,4(2):141–147. 10.1053/euje.4.2.141

    CAS  PubMed  Google Scholar 

  44. Alexander JH, Peterson ED, Chen AY, Harding TM, Adams DB, Kisslo JA Jr: Feasibility of point-of-care echocardiography by internal medicine house staff. Am Heart J 2004,147(3):476–481. 10.1016/j.ahj.2003.10.010

    PubMed  Google Scholar 

  45. Royse CF, Seah JL, Donelan L, Royse AG: Point of care ultrasound for basic haemodynamic assessment: novice compared with an expert operator. Anaesthesia 2006,61(9):849–855. 10.1111/j.1365-2044.2006.04746.x

    CAS  PubMed  Google Scholar 

  46. Mayo PH, Beaulieu Y, Doelken P, Feller-Kopman D, Harrod C, Kaplan A, Oropello J, Vieillard-Baron A, Axler O, Lichtenstein D, Maury E, Slama M, Vignon P: American College of Chest Physicians/La Societe de Reanimation de Langue Francaise statement on competence in critical care ultrasonography. Chest 2009,135(4):1050–1060. 10.1378/chest.08-2305

    PubMed  Google Scholar 

Download references

Acknowledgements

We are indebted to A Wolfe, MD, for English editing.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mathieu Jozwiak.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

MJ performed analysis and interpretation of the data and drafted the manuscript. XM contributed to analysis and interpretation of the data and to drafting of the manuscript. RC contributed to analysis and interpretation of the data and to drafting of the manuscript. FB performed the collection of data, contributed to analysis and interpretation of the data and helped to draft the manuscript. JR participated in the design of the study, contributed to analysis and interpretation of the data and helped to draft the manuscript. GB conceived the study, performed the collection of data, performed analysis and interpretation of the data and drafted the manuscript. All authors read and approved the final manuscript.

Electronic supplementary material

13613_2013_176_MOESM1_ESM.docx

Additional file 1: Receiver-operating characteristics curve generated to identify the score cutoff that predicted full agreement between all residents (n = 16) and experts regarding the diagnosis and treatment. (DOCX 15 KB)

Authors’ original submitted files for images

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jozwiak, M., Monnet, X., Cinotti, R. et al. Prospective assessment of a score for assessing basic critical-care transthoracic echocardiography skills in ventilated critically ill patients. Ann. Intensive Care 4, 12 (2014). https://doi.org/10.1186/2110-5820-4-12

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/2110-5820-4-12

Keywords