Skip to main content

ORIGINAL RESEARCH article

Front. Med., 02 March 2022
Sec. Ophthalmology
This article is part of the Research Topic Ocular Ultrasonography and Optical Coherence Tomography in the Optic Nerve Disease View all 9 articles

Accuracy of Optic Nerve Sheath Diameter Measurements in Pocket-Sized Ultrasound Devices in a Simulation Model

\nGarrett G. R. J. JohnsonGarrett G. R. J. Johnson1Tomislav JelicTomislav Jelic2Angela DerksenAngela Derksen3Bertram UngerBertram Unger4Frederick A. Zeiler,,,,Frederick A. Zeiler5,6,7,8,9Markus T. ZiesmannMarkus T. Ziesmann1Lawrence M. Gillman
Lawrence M. Gillman1*
  • 1Department of Surgery, University of Manitoba, Winnipeg, MB, Canada
  • 2Department of Emergency Medicine, University of Manitoba, Winnipeg, MB, Canada
  • 3Emergency Department, Seven Oaks General Hospital, Winnipeg, MB, Canada
  • 4Department of Internal Medicine, University of Manitoba, Winnipeg, MB, Canada
  • 5Section of Neurosurgery, Department of Surgery, University of Manitoba, Winnipeg, MB, Canada
  • 6Department of Anatomy and Cell Science, University of Manitoba, Winnipeg, MB, Canada
  • 7Biomedical Engineering, Faculty of Engineering, University of Manitoba, Winnipeg, MB, Canada
  • 8Centre on Aging, University of Manitoba, Winnipeg, MB, Canada
  • 9Division of Anaesthesia, Department of Medicine, University of Cambridge, Cambridge, United Kingdom

Introduction: Transorbital sonographic measurement of optic nerve sheath diameter (ONSD) is an emerging non-invasive technique for the identification and monitoring of intracranial hypertension. In recent years, new pocket ultrasound devices have become available, and it is uncertain if they have the resolution to measure such small structures appropriately as compared to their predecessors. In this study, we measure the performance of three ultrasound units on a simulation model to establish their precision and accuracy.

Methods: ONSD was measured by three expert point-of-care sonographers using ultrasound machines three times on each of seven discrete ONS model sizes ranging from 3.5 to 7.9 mm. Two pocket ultrasounds (IVIZ, Sonosite, and Lumify, Philips) and one standard-sized portable ultrasound (M-Turbo, Sonosite) were used. Measurements were analyzed for mean error and variance and tested for significance using blocked covariance matrix regression analyses.

Results: The devices differed in their variances (Lumify: 0.19 mm2, M-Turbo: 0.26 mm2, IVIZ: 0.34 mm2) and their mean error (Lumify: −0.05 mm, M-Turbo: 0.10 mm, IVIZ: −0.10 mm). The difference in mean error between users is not significant (p = 0.45), but there is a significant difference in mean error between devices (p = 0.02).

Conclusions: Accurate ONSD measurement is possible utilizing pocket-sized ultrasound, and in some cases, may be more accurate than larger portable ultrasound units. While the differences in these devices were statistically significant, all three were highly accurate, with one pocket device (Lumify) outperforming the rest. Further study in human subjects should be conducted prior to using pocket ultrasound devices for in vivo diagnosis of intracranial hypertension.

Introduction

Intracranial hypertension (IH) is a lethal and relatively common phenomenon in critically ill traumatic brain-injured patients. While these patients' prognosis is guarded, they fair much worse if this condition is not diagnosed accurately and treated promptly (13). Current modalities used to diagnose IH include clinical examination, imaging, and invasive intracranial monitors (4). While CT scan and MRI aid in the diagnosis of IH, they are time-consuming and are difficult to administer repeatedly to provide continuous intracranial pressure (ICP) monitoring often required by these patients (5, 6). Physical examination findings alone are not sufficiently sensitive or specific and may be difficult to appreciate in patients with multiple injuries (7, 8). ICP monitoring devices are considered gold standard for the diagnosis and monitoring of IH. Their limitations are that they are invasive, require neurosurgical expertise both to administer and monitor, and are associated with risks including bleeding and infection (9).

Transorbital ultrasound assessment of optic nerve sheath diameter (ONSD) as a non-invasive means to diagnose and monitor patients suspected of IH has been investigated with promising results (1014). However, point-of-care ultrasound (POCUS) measurements, in general, are operator-dependent (1520), and some authors question their diagnostic utility (21). A recent metaanalysis has demonstrated high diagnostic accuracy of ONSD across 50 studies (22). The use of POCUS in emergency departments, medical wards, and intensive care units as an adjunct to the physical exam is widespread. This is likely due to improvements in ultrasound technology leading to smaller ultraportable devices, less expensive technology, and the dissemination of ultrasound expertise as the technique becomes more established. However, most literature validating ONSD measurements of ICP has used larger portable ultrasound machines (15). It is unclear how this modality can translate to newer handheld machines, which may have a limited range of probe frequencies, lower penetration, touch screens, smaller screen sizes, and varying screen resolutions. ONSD measurement by ultrasound requires accurate measurement of a subcentimeter structure to the nearest 0.1 mm (19), and it is unclear if operators using these newer ultrasound devices can perform this task effectively. In the past, we have shown, using a simulation model, that one pocket-sized ultrasound device (Vscan, GE Healthcare) performed equal to a standard-sized validated ultrasound (M-turbo, Sonosite) with respect to intra and interobserver variability, and there was a high level of agreement between measurements obtained using the two machines (15). However, each new pocket ultrasound device is unique, with differing manufacturer settings, screen sizes, and probe frequencies, and therefore should be tested as they become available prior to using it for this critical diagnostic purpose. The present study aimed to compare two newer hand-held ultrasound units (Sonosite IVIZ and Philips Lumify) to a previously validated portable unit (Sonosite M-Turbo) utilizing a simulation model of the ONS and to determine their relative measurement errors and variance.

Materials and Methods

Ethics

The study protocol was submitted to the University of Manitoba Health Research Ethics Board and determined not to require ethics review.

Study Design

Measurements were made using a simulation model of the ONS as published previously (23) (Figure 1). In brief, medical tubing of various diameters was cut to 1 cm in length, encased in an opaque gelatin-psyllium powder matrix, and placed in StyrofoamTM coffee cups. The common B-scan ultrasound technique for measuring ONSD in the literature was used (11, 12, 18, 24, 25). This is performed by placement of the probe over the simulated orbit to identify an axial image of the ONS behind the globe. The digital calipers are used to identify a position 3 mm behind the optic disk, at which point the ONSD is measured. Three ultrasound units were compared: Philips LumifyTM with linear 12–4 MHz probe using the vascular preset and a depth of 2–4 cm, (Koninklijke Philips N.V., Amsterdam, Netherlands) connected to a Samsung Galaxy Tab S2TM (Samsung Group, Seoul, South Korea); Sonosite IVIZTM with linear 10–5 MHz probe using the vascular preset and a depth of 2–4 cm(SonoSite Inc, Bothell, WA, USA); and Sonosite M-TurboTM with 13–6 MHz linear array using the ophthalmic preset and a depth of 2–4 cm(SonoSite Inc, Bothell, WA, USA). The ophthalmic presets did not exist for the two pocket devices. The vascular presets were selected for these models because they most closely approximated the image quality of the ophthalmic preset. For all three devices, the user cannot directly control the ultrasound output power. Rather the system does this automatically to limit mechanical index (MI) and thermal index (TI) below the maximum thresholds for the selected presets. Power outputs were monitored intermittently for all three ultrasound devices to assess whether they could stay below FDA safety thresholds for ophthalmic use. Gain settings were adjusted by the operators in real time to attain the clearest images. Sonographers obtained their own images and measured each model in random order with each machine three times. Randomization was performed by assigning each model in a computer-generated random sequence, about which participants were unaware. All models appeared identical (Figure 1A), identifiable only by a letter written on the bottom of the coffee cup. Operators were blinded to the model's identity, the actual diameters of the tubing, and to each other's measurements. Trials were blocked by machine so that each operator made all measurements with one machine before moving on to the next. The order of the machine each operator used in sequence was also random and was predetermined by computer-generated random sequence.

FIGURE 1
www.frontiersin.org

Figure 1. (A) Simulation model made with a short segment of intravenous or nasogastric tube suspended in gelatin, under a gelatin eyeball. (B) Image of simulation model obtained from Onsite M-turbo (standard sized portable ultrasound) zoomed in with superimposed arrows to highlight measurement technique. (C) Image of simulation model from Sonosite IVIZ (pocket ultrasound) device. (D) Image of simulation model from Philips Lumify (pocket ultrasound) device. All measurements performed at 3 mm behind the simulated orbit. Calipers used to measure distance behind the globe not shown in (C,D).

Participants

Measurements were conducted by three POCUS experts (LG, TJ, and AD) in a single 3 h session. Experts were physicians with additional POCUS training including ONSD measurement training (fellowship or ultrasound courses), and who use POCUS in their usual clinical practice. However, none of these experts perform ONSD measurements in their typical clinical practice as this technique is largely considered to be investigational in our center.

Sample Size

We defined a difference in the measurement error of 0.5 mm or less between devices as equivalent. Using the B-scan technique, many authors have examined the range in “normal” ONSD values in healthy subjects. The standard deviation of the mean normal ONSD size varies by ≥0.5 mm in most of these studies (20, 2628). Therefore, as a SD ± 0.5 mm is inherent to the technique, due to variations in normal anatomy, this threshold was chosen as the cutoff for acceptable variation between devices. We felt that a smaller difference between devices was unlikely to be clinically significant. The expected standard deviation was set at 0.51 mm, based on a prior study using the same simulation models and experts (23). Significance was set at 0.05, and power at 90%, to calculate a required sample size of at least 23 measurements per ultrasound device (29). Seven models were made using various tube diameters to simulate the range of ONSD sizes found in vivo (13, 19). The diameters were 3.5 mm (polyvinyl intravenous line tubing), 4 mm (nasogastric tube), 4.2 mm (spring wire guide sheath), 4.6 mm (nasogastric tube), 5.5 mm (nasogastric tube), 6 mm (tracheostomy canula), and 7.9 mm (nasogastric tube). Sizes of tubes were confirmed using digital calipers (Neiko 01407A, Neiko®, Taiwan, ROC) calibrated to the nearest 0.1 mm. Tube diameters were verified immediately prior to data collection, and again at the end of the study (and remained identical). The diameters were chosen so they clustered around 4–6 mm as this is where an ultrasonographer would have to discriminate between normal and abnormal ONSD (18). There were seven models, three sonographers, and three ultrasound machines. Each measurement was performed in triplicate. There were a total of 189 measurements performed, with 63 measurements per ultrasound device.

Outcomes

Study primary outcomes were measurement error and variance stratified by the ultrasound machine. Ultrasound user measurement error and error stratified by model were measured to account for heterogeneity between operators or models.

Data Analysis

All statistical analyses were performed using SAS version 9.3 (SAS Institute, Cary NC, USA). Figures were generated using SPSS Statistics version 27 (IBM, Armonk, NY, USA). Ultrasound measurements were compared to tube diameter as measured separately with digital calipers. Previous determinations of ONSD measurement accuracy have relied upon Bland–Altman agreement analysis to estimate a true ONS size based upon mean measurements (15). By using a simulation model with a physical tube of known diameter, the “true” ONSD can be measured precisely, and thus measurement error can be calculated. Devices were compared for mean squared error, variance, and error (bias). Blocked covariance matrix regression analyses using a series of F-tests based upon maximum likelihood were performed to analyze the effects of device, user, and model size on measurement accuracy.

Results

Device Accuracy

The mean squared error for the Philips Lumify, Sonosite M-Turbo, and Sonosite IVIZ were 0.19, 0.27, and 0.35 mm2 respectively. The variances were 0.19, 0.26, and 0.34mm2 for the Philips, the M-turbo, and the IVIZ respectively. Measurement error stratified by ultrasound machine is shown in Figure 1 and was statistically significant at p = 0.02.

Interobserver and Between Model Variability

Upon regression analysis, the differences in measurement error between users were not significant (p = 0.45). Measurement error stratified by the user, and by ONSD size are shown in Figures 3, 4 respectively.

Safety Data

The Philips device had an MI range from 0.4 to 0.9 and a TI from 0.0 to 0.1 during the study period. For the IVIZ, the MI ranged from 0.7–0.8 and the TI from 0.02–0.1. For the M-turbo, MI was 0.2 and TI 0–0.1.

Discussion

It was previously unknown if new pocket ultrasound devices can be used to make clinically useful ONSD measurements similar to their larger predecessors. Preliminary Vscan data (GE healthcare) were promising (15), but until now other new ultrasound machines have not been tested for this purpose. We aimed to measure the accuracy of ONSD measurements of two newer pocket-sized handheld ultrasound devices (IVIZ and Lumify) and of a conventional sized portable unit (M-turbo). This was achieved by using our ultrasound model, which allowed us to compare actual sheath diameter to the measurements obtained by the ultrasound devices and determine their difference (error) and variance. This study demonstrated that mean squared error is the lowest in the Philips device, followed by the M-turbo, and then the IVIZ, driven largely by the device variance. Interobserver variation was low and not significantly different between operators in this study.

The mean squared error is presented as a composite measure of both the variance and bias (mean error) of the ultrasound devices, as both are important measures of device performance. We found that the Philips Lumify device outperforms the two Sonosite machines, with the IVIZ performing the worst. The devices are similar concerning their mean errors but are quite different in their variances (Figure 2). This suggests that different aspects of the ultrasound devices affect the users' precision but do not cause one device to over-or under-estimate the diameter. The IVIZ, which had the worst precision, only had a standard deviation of its error of 0.076 mm larger than the M-turbo machine. When determining a 3–8 mm structure's size (13, 19), a <0.1 mm increase in error would likely not make much of a clinically significant difference. For example, a 0.075 mm measurement error is much lower than previously reported values of interobserver variability of ±0.2 mm (30). Furthermore, this small measurement error is insignificant in comparison to the variation in reported ONSD measurement threshold values which vary as much as 1 mm in the literature (31). Some authors contend that a trend in increasing repeated ONSD measurements or extreme values is more useful in diagnosis to account for these measurement uncertainties (32). Based on the results of our current study, using one ultrasound unit for repeated measurement may be prudent so as to diminish between-device measurement variability.

FIGURE 2
www.frontiersin.org

Figure 2. Box and whisker plot of measurement error (individual observed values minus predicted) stratified by the ultrasound device.

The variance found in our study is smaller than what we have previously found in simulation models using conventional ultrasound (18). This is likely due to our exclusive reliance on expert sonographers as opposed to using novices. On analysis of our users, we found that they did not significantly differ with regards to their mean error or their variance when compared across all machines and model sizes (Figure 3), indicating that they all had a similar technique, and did not affect the differences we see between machines.

FIGURE 3
www.frontiersin.org

Figure 3. The Box and whisker plot of measurement error (individual observed values minus predicted) stratified by user.

Interestingly, when stratifying by ONSD model size, we find that the smallest model (3.5 mm) caused users to overestimate its size across all machines without a substantial corresponding increase in variance (Figure 4). This may be due to smaller structures inherently being more difficult to measure accurately and had we added another even smaller tube diameter to our study, we may have found this trend to continue.

FIGURE 4
www.frontiersin.org

Figure 4. The Box and whisker plot of percent measurement error (individual observed values minus predicted) stratified by predicted size of model optic nerve sheath diameter.

One potential source of error in our model is that the materials used to simulate the ONS were slightly different between models. It is reasonable to assume that they would not all perform equally well when measured by ultrasound as they are likely to refract sonographic waves differently causing backscatter and reduced image clarity. We used tubing of various diameters from medical supplies made out of a variety of different plastics. However, when we analyzed and validated these models previously, we found that no model appeared to stand out as a poor performer (23). Again, in our current study, none of the models appeared to stand out as being a particular outlier, other than the smallest tube, which was composed of the same materials as many of the larger tubes. If the tubing composition did affect experts' ability to measure tube diameter, it was likely so small of an effect as to be undetectable in our current study.

Our model with known measurable tube sizes also highlights some of the difficulty of ultrasound determination of ONSD as a diagnostic test in general. In our study, experts in a controlled setting with no distractions and low variability in their repeated measurements over time, occasionally (rarely) over or under-estimated the ONS size by as much as 1.6 mm. For measurement of a structure with a cut-off value of 5–6 mm between normal and abnormal (13), a 1 mm difference can be a large clinically important discrepancy. It is important to remember that ONSD assessment is only one component of the clinical assessment of a patient with suspected IH, and that results must be interpreted in a greater clinical context. All diagnostic tests have false positives and negatives, and other in vivo studies have shown reasonable sensitivity and specificity of sonographic ONSD for IH as compared to other diagnostic modalities (13, 24, 3335), indicating that in practice, measurement error this large is likely rare enough to not preclude ocular ultrasound for this purpose.

Comparison of three ultrasound devices produced some results that we were not expecting to measure. The Sonosite IVIZ overheated and crashed multiple times throughout the 3-h session, so its protective case was removed, and a portable fan was directed at it in order for it to function. This was not an issue for the Lumify or the M-turbo. The IVIZ battery life was also much shorter than that of the Lumify and could not be charged and used simultaneously, so two separate battery packs were used to complete the 3-h session. Most ultrasound machines would not be expected to function for such long continuous use in normal clinical applications, so this is likely not significant for in vivo applications.

Despite the importance of our findings, there are limitations to our study. Data comparing the ultrasound devices were measured on a simulation model in a controlled experimental setting. This was chosen by design to focus on the ultrasound devices themselves rather than external factors such as stressors in a clinical environment, patient variability, and time constraints. It also allows for a “gold standard” comparison against the measurable tube diameters used to simulate the ONS. However, it may be difficult to extrapolate the findings in vivo. We found low variance and measurement error, which may differ once clinical and patient factors are introduced. Our model itself may have also presented some errors of its own. The tubes may be more easily measured than the ONS of a real patient due to the lack of necessary concern for patient comfort, perpendicular tube position, and lack of artifact from ocular structures. Our model can only simulate the B-scan method of sonographic ONSD assessment, which is the most common method described in the literature, but is potentially inferior to a more recent method described (13, 36). Benefits of this method include ease of application, as the newer method requires careful image acquisition accounting for multiple structures in the orbit. Alternate methods such as trends in measurement over time (32), as well as automated measurement techniques have also been investigated with promising results (3739).

Another limitation to our study is inherent to the popular B-scan ultrasound technique used to acquire images. Due to non-standardized gain settings used to acquire images, a “blooming effect” occurs, where larger gains cause the ONS to appear larger, and smaller gains cause it to appear smaller (40). This effect leads to artifacts (41) and decreased repeatability of measurements between ONSD studies (42). As in real life, gain was not standardized across devices during the present study, which may account for some of the variation observed. An alternate measurement technique, called the A-scan technique, uses a non-focused probe, applied to the open, anesthetized eye, and is recommended as a superior alternative to the B-scan technique, as it is free from this blooming effect (43). Whether the present simulation model and the pocket ultrasound devices can accurately apply this A-scan technique requires further research.

Images obtained using the Lumify attached to the Samsung smart tablet also subjectively had more clarity than the other two devices. This is partially explained by the tablet's high resolution, which has an 8-inch screen with 1,536 × 2,048 pixels (44). The iViz has a 7-inch screen with 1,920 × 1,200 pixels (45), and the M-Turbo has a 10.4-inch screen with 800 × 600 pixels (46). It is no surprise that the image was sharper on the Samsung tablet using the Lumify device compared to the M-turbo, however, the iViz screen resolution is similar to the tablet, so the increased image clarity of the Lumify may be related to other factors such as software interface, probe performance, and other hardware. These all may have been contributing factors that affected the variance in measurements observed between the ultrasound devices and lead to some of the improved performance of the Lumify over the others. It is unclear if these results would change if using the Lumify device on another smart tablet, however, it has been previously suggested that screen resolution and pixelization have minimal effects on measurement accuracy for sonographic measurements (47). Finally, we used a relatively small group of experts. As ONSD measurement is still considered to be experimental due to debate around appropriate cutoff values between normal and abnormal (48), only a limited number of practitioners in our center have sufficient experience with this technique.

Most pocket ultrasounds are not currently approved in the United States or Canada for ONSD measurement in humans. The existing devices generally do not have the required manufacturer presets to make these measurements safely. The recommended settings for ONSD ultrasound in human subjects require a TI ≤ 1 and MI ≤ 0.23 (49). The MI and TI are based upon the frequency output of the device, the depth of exam, and the tissue properties being examined. Manufacturer presets use software to limit the ultrasound focal length and energy output so that they do not exceed these safety thresholds (41). During our data collection, the Lumify and IVIZ did not have ocular ultrasound manufacturer presets, so we did not maintain their MI below the safety threshold during our study, which was part of the rationale to use a simulation model rather than human subjects for our measurements. These devices do however have the capability to display the MI and TI which could potentially be adjusted to maintain their levels below the recommended safety thresholds, so they could potentially be used in the future for this purpose. In fact, subsequent to our data collection, Sonosite IVIZ's newest firmware does provide for an ophthalmic preset using certain probes. The Philips device does not yet have ophthalmic presets (45, 50). We caution users that ophthalmic presets must be developed before pocket ultrasound units can be safely used in human subjects for ocular ultrasound.

Conclusion

In summary, we found that the ultrasound devices differ in their bias and variance with the Lumify device performing the best and the IVIZ performing the worst, however not differing enough to be clinically relevant. We conclude that these pocket ultrasounds do appear to have the resolution to make an accurate determination of ONSD as well as the full-sized portable unit. However, each device is different and new models must be tested prior to use for this purpose. While it is unclear whether ultrasound will ever replace intracranial monitors in the diagnosis and management of IH, pocket ultrasound devices are a promising tool for the assessment of neurocritically ill patients, especially when access to the gold standard is limited, such as in rural or remote settings. As pocket ultrasound continues to expand beyond the tertiary care centers and enters the non-university hospital world, this has the potential to become a real triage tool like FAST, eFAST, and other POCUS applications. Adequate safety settings and regulatory approval are however necessary first before these devices can be used in this matter for ONSD measurement.

Meetings

This work was presented as a poster at the American College of Surgeons Clinical Congress in October 2020.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author Contributions

LG, GJ, TJ, and AD were involved in data collection. All authors were involved in study design, data analysis, manuscript composition, read, and approved the final manuscript. All authors contributed to the article and approved the submitted version.

Funding

FAZ receives research support from the Manitoba Public Insurance (MPI) Neuroscience Research Endowment/Operating Fund, the United States National Institutes of Health (NIH) through the National Institute of Neurological Disorders and Stroke (NINDS), the Canadian Institutes of Health Research (CIHR), the Canada Foundation for Innovation (CFI), the University of Manitoba VPRI Research Investment Fund (RIF), the University of Manitoba Rudy Falk Clinician-Scientist Professorship, the University of Manitoba Center on Aging Fellowship, the Winnipeg Rh Institute/University of Manitoba - Falconer Emerging Research Rh Award, and the Health Sciences Centre Foundation Winnipeg.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Pickard JD, Czosnyka M. Management of raised intracranial pressure. J Neurol Neurosurg Psychiatry. (1993) 56:845–58. doi: 10.1136/jnnp.56.8.845

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Schreiber MA. Determinants of mortality in patients with severe blunt head injury. Arch Surg. (2002) 137:285. doi: 10.1001/archsurg.137.3.285

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Badri S, Chen J, Barber J, Temkin NR, Dikmen SS, Chesnut RM, et al. Mortality and long-term functional outcome associated with intracranial pressure after traumatic brain injury. Intensive Care Med. (2012) 38:1800–9. doi: 10.1007/s00134-012-2655-4

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Carney N, Totten AM, O'Reilly C, Ullman JS, Hawryluk GWJ, Bell MJ, et al. Guidelines for the Management of severe traumatic brain injury. Neurosurgery. (2016) 80:6–15. doi: 10.1227/NEU.0000000000001432

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Geeraerts T, Newcombe VFJ, Coles JP, Abate MG, Perkes IE, Hutchinson PJA, et al. Use of T2-weighted magnetic resonance imaging of the optic nerve sheath to detect raised intracranial pressure. Critical Care. (2008) 12:R114. doi: 10.1186/cc7006

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Hylkema C. Optic Nerve Sheath Diameter Ultrasound and the Diagnosis of Increased Intracranial Pressure. Crit Care Nurs Clin North Am. (2016) 28:95–9. doi: 10.1016/j.cnc.2015.10.005

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Fernando SM, Tran A, Cheng W, Rochwerg B, Taljaard M, Kyeremanteng K, et al. Diagnosis of elevated intracranial pressure in critically ill adults: systematic review and meta-analysis. BMJ. (2019) 366:l4225. doi: 10.1136/bmj.l4225

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Avest ET, Taylor S, Wilson M, Lyon RL. Prehospital clinical signs are a poor predictor of raised intracranial pressure following traumatic brain injury. Emerg Med J. (2021) 38:21–6. doi: 10.1136/emermed-2020-209635

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Ragland J, Lee K. Critical care management and monitoring of intracranial pressure. J‘ Neurocrit Care. (2016) 9:105–12. doi: 10.18700/jnc.160101

CrossRef Full Text | Google Scholar

10. Robba C, Santori G, Czosnyka M, Corradi F, Bragazzi N, Padayachy L, et al. Optic nerve sheath diameter measured sonographically as non-invasive estimator of intracranial pressure: a systematic review and meta-analysis. Intensive Care Med. (2018) 44:1284–94. doi: 10.1007/s00134-018-5305-7

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Geeraerts T, Merceron S, Benhamou D, Vigué B, Duranteau J. Non-invasive assessment of intracranial pressure using ocular sonography in neurocritical care patients. Intensive Care Med. (2008) 34:2062–7. doi: 10.1007/s00134-008-1149-x

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Kimberly HH, Shah S, Marill K, Noble V. Correlation of optic nerve sheath diameter with direct measurement of intracranial pressure. Acad Emerg Med. (2008) 15:201–4. doi: 10.1111/j.1553-2712.2007.00031.x

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Soliman I, Johnson GGRJ, Gillman LM, Zeiler FA, Faqihi F, Aletreby WT, et al. New optic nerve sonography quality criteria in the diagnostic evaluation of traumatic brain injury. Crit Care Res Pract. (2018) 2018:1–7. doi: 10.1155/2018/3589762

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Chen L, Wang L, Hu Y, Jiang X, Wang Y, Xing Y. Ultrasonic measurement of optic nerve sheath diameter: a non-invasive surrogate approach for dynamic, real-time evaluation of intracranial pressure. Br J Ophthalmol. (2019) 103:437–41. doi: 10.1136/bjophthalmol-2018-312934

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Johnson GGRJ, Zeiler FA, Unger B, Hansen G, Karakitsos D, Gillman LM. Estimating the accuracy of optic nerve sheath diameter measurement using a pocket-sized, handheld ultrasound on a simulation model. Crit Ultrasound J. (2016) 8:1–5. doi: 10.1186/s13089-016-0053-9

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Zeiler FA, Ziesmann M, Goeres P, Unger B, Park J, Karakitsos D, et al. unique method for estimating the reliability learning curve of optic nerve sheath diameter ultrasound measurement. Crit Ultrasound J. (2016) 8:4. doi: 10.1186/s13089-016-0044-x

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Zeiler FA, Unger B, Kramer AH, Kirkpatrick AW, Gillman LM A. Unique Model for Ultrasound Assessment of Optic Nerve Sheath Diameter. Can J Neurol Sci. (2014) 40:225–9. doi: 10.1017/S0317167100013779

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Zeiler FA, Unger B, Zhu Q, Xiao J, Kirkpatrick AW, Kramer AH, et al. Unique Model for ONSD Part II: Inter/Intra-operator Variability. Can J Neurolo Sci. (2014) 41:430–5. doi: 10.1017/S0317167100018448

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Goeres P, Zeiler FA, Unger B, Karakitsos D, Gillman LM. Ultrasound assessment of optic nerve sheath diameter in healthy volunteers. J Crit Care. (2016) 31:168–71. doi: 10.1016/j.jcrc.2015.10.009

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Bäuerle J, Lochner P, Kaps M, Nedelmann M. Intra- and interobserver reliability of sonographic assessment of the optic nerve sheath diameter in healthy adults. J Neuroimaging. (2012) 22:42–5. doi: 10.1111/j.1552-6569.2010.00546.x

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Agrawal D, Raghavendran K, Zhao L, Rajajee V A. Prospective Study of Optic Nerve Ultrasound for the Detection of Elevated Intracranial Pressure in Severe Traumatic Brain Injury. Crit Care Med. (2020) 48:e1278–85. doi: 10.1097/CCM.0000000000004689

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Sallam A, Abdelaal Ahmed Mahmoud M. Alkhatip A, Kamel MG, Hamza MK, Yassin HM, Hosny H, Younis MI, Ramadan E, Algameel HZ, Abdelhaq M, et al. The diagnostic accuracy of noninvasive methods to measure the intracranial pressure: a systematic review and meta-analysis. Anesth Analg. (2021) 132:686–95. doi: 10.1213/ANE.0000000000005189

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Johnson GGRJ, Jelic T, Derksen A, Unger B, Zeiler F, Ziesmann M, Gillman LM. A new inexpensive simulation model for ultrasound assessment of optic nerve sheath diameter. Can J Neurol Sci. (2020) 47:543–8. doi: 10.1017/cjn.2020.37

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Geeraerts T, Launey Y, Martin L, Pottecher J, Vigué B, Duranteau J, et al. Ultrasonography of the optic nerve sheath may be useful for detecting raised intracranial pressure after severe brain injury. Intensive Care Med. (2007) 33:1704–11. doi: 10.1007/s00134-007-0797-6

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Blaivas M, Theodoro D, Sierzenski PR. Elevated intracranial pressure detected by bedside emergency ultrasonography of the optic nerve sheath. Aca Emerg Med. (2003) 10:376–81. doi: 10.1197/aemj.10.4.376

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Garcia JPS, Garcia PT, Rosen RB, Finger PT A. 3-dimensional ultrasound C-scan imaging technique for optic nerve measurements. Ophthalmology. (2004) 111:1238–43. doi: 10.1016/j.ophtha.2003.10.026

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Chen H, Ding G-S, Zhao Y-C, Yu R-G, Zhou J-X. Ultrasound measurement of optic nerve diameter and optic nerve sheath diameter in healthy Chinese adults. BMC Neurol. (2015) 15:106. doi: 10.1186/s12883-015-0361-x

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Avci M, Kozaci N, Komut E, Komut S, Caliskan G, Tulubas G. The Measurement of Elderly Volunteers' Optic Nerve Sheath Diameters by Ocular Ultrasonography. Medicina (Kaunas). (2019) 55:E413. doi: 10.3390/medicina55080413

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Julious SA. Sample sizes for clinical trials with Normal data. Stat Med. (2004) 23:1921–86. doi: 10.1002/sim.1783

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Ballantyne SA, O'Neill G, Hamilton R, Hollman AS. Observer variation in the sonographic measurement of optic nerve sheath diameter in normal adults. Eur J Ultrasound. (2002) 15:145–9. doi: 10.1016/S0929-8266(02)00036-8

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Koziarz A, Sne N, Kegel F, Nath S, Badhiwala JH, Nassiri F, et al. Bedside Optic Nerve Ultrasonography for Diagnosing Increased Intracranial Pressure. Ann Intern Med. (2019) 171:896. doi: 10.7326/M19-0812

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Bender M, Lakicevic S, Pravdic N, Schreiber S, Malojcic B. Optic nerve sheath diameter sonography during the acute stage of intracerebral hemorrhage: a potential role in monitoring neurocritical patients. Ultrasound J. (2020) 12:1–8. doi: 10.1186/s13089-020-00196-1

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Soldatos T, Karakitsos D, Chatzimichail K, Papathanasiou M, Gouliamos A, Karabinis A. Optic nerve sonography in the diagnostic evaluation of adult brain injury. Crit Care. (2008) 12:R67. doi: 10.1186/cc6897

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Moretti R, Pizzi B, Cassini F, Vivaldi N. Reliability of Optic Nerve Ultrasound for the Evaluation of Patients with Spontaneous Intracranial Hemorrhage. Neurocrit Care. (2009) 11:406–10. doi: 10.1007/s12028-009-9250-8

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Dubourg J, Javouhey E, Geeraerts T, Messerer M, Kassai B. Ultrasonography of optic nerve sheath diameter for detection of raised intracranial pressure: a systematic review and meta-analysis. Intensive Care Med. (2011) 37:1059–68. doi: 10.1007/s00134-011-2224-2

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Sargsyan AE, Blaivas M, Geeraerts T, Karakitsos D. “Ocular Ultrasound in the Intensive Care Unit” in Critical Care Ultrasound. In: Lumb P, Karakitsos D, editors. Critical Care Ultrasound. Philadelphia, PA: Elsevier (2014).

Google Scholar

37. Meiburger KM, Naldi A, Michielli N, Coppo L, Fassbender K, Molinari F, et al. Automatic Optic Nerve Measurement: A New Tool to Standardize Optic Nerve Assessment in Ultrasound B-Mode Images. Ultrasound Med Biol. (2020) 46:1533–44. doi: 10.1016/j.ultrasmedbio.2020.01.034

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Soroushmehr R, Rajajee K, Williamson C, Gryak J, Najarian K, Ward K, et al. Automated Optic Nerve Sheath Diameter Measurement Using Super-pixel Analysis. Annu Int Conf IEEE Eng Med Biol Soci. (2019) 2019:2793–6. doi: 10.1109/EMBC.2019.8856449

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Gerber S, Jallais M, Greer H, McCormick M, Montgomery S, Freeman B, et al. Automatic Estimation of the Optic Nerve Sheath Diameter from Ultrasound Images. Imaging Patient Cust Simul Syst Point Care ultrasound. (2017) 10549:113–20. doi: 10.1007/978-3-319-67552-7_14

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Vitiello L, De Bernardo M, Capasso L, Cornetta P, Rosa N. Optic Nerve Ultrasound Evaluation in Animals and Normal Subjects. Front Med. (2022) 8:797018. doi: 10.3389/fmed.2021.797018

PubMed Abstract | CrossRef Full Text | Google Scholar

41. De Bernardo M, Vitiello L, Rosa N. Optic nerve ultrasonography for evaluating increased intracranial pressure in severe preeclampsia. Int J Obstet Anesth. (2019) 38:147. doi: 10.1016/j.ijoa.2018.12.010

PubMed Abstract | CrossRef Full Text | Google Scholar

42. De Bernardo M, Vitiello L, Rosa N. Ultrasound optic nerve sheath diameter evaluation in patients undergoing robot-assisted laparoscopic pelvic surgery. J Robot Surg. (2019) 13:709–10. doi: 10.1007/s11701-019-00966-7

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Ossoinig KC. “Standardized echography of the optic nerve.,”. In: Till P, editor. Ophthalmic Echography 13: Proceedings of the 13th SIDUO Congress, Vienna, Austria, 1990. Documenta Ophthalmologica Proceedings Series. Dordrecht: Springer Netherlands (1993). p. 3–99.

Google Scholar

44. Samsung Galaxy Tab S2 Product Manual. Samsung Group (2015). Available online at: https://www.samsung.com/us/business/support/owners/product/galaxy-tab-s2-9-7-wi-fi/ (accessed December 8, 2021).

Google Scholar

45. Sonosite IVIZ User Manual,. FUJIFILM SonoSite, Inc. (2018). Available online at: https://www.sonosite.com/sites/default/files/iViz_UG_ENG_P20016-07A_e.pdf (accessed May 4, 2021).

Google Scholar

46. Ball CG, Ranson K, Dente CJ, Feliciano DV, Laupland KB, Dyer D, et al. Clinical predictors of occult pneumothoraces in severely injured blunt polytrauma patients: a prospective observational study. Injury. (2009) 40:44–7. doi: 10.1016/j.injury.2008.07.015

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Goldstein A. Errors in ultrasound digital image distance measurements. Ultrasound Med Biol. (2000) 26:1125–32. doi: 10.1016/S0301-5629(00)00249-0

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Stevens RRF, Gommer ED, Aries MJH, Ertl M, Mess WH, Huberts W, et al. Optic nerve sheath diameter assessment by neurosonology: A review of methodologic discrepancies. J Neuroimaging. (2021) 31:814–25. doi: 10.1111/jon.12906

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Marketing Clearance of Diagnostic Ultrasound Systems and Transducers (2019). Available online at: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/marketing-clearance-diagnostic-ultrasound-systems-and-transducers (accessed October 18, 2021).

Google Scholar

50. Lumify Ultrasound System User Manual. Philips Healthcare (2016). Available online at: http://incenter.medical.philips.com/doclib/enc/12805707/Getting_Started.pdf%3Ffunc%3Ddoc.Fetch%26nodeid%3D12805707 (accessed May 4, 2021).

Google Scholar

Keywords: ultrasound, intracranial pressure, point-of-care, simulation, intracranial hypertension, optic nerve

Citation: Johnson GGRJ, Jelic T, Derksen A, Unger B, Zeiler FA, Ziesmann MT and Gillman LM (2022) Accuracy of Optic Nerve Sheath Diameter Measurements in Pocket-Sized Ultrasound Devices in a Simulation Model. Front. Med. 9:831778. doi: 10.3389/fmed.2022.831778

Received: 04 January 2022; Accepted: 31 January 2022;
Published: 02 March 2022.

Edited by:

Maddalena De Bernardo, University of Salerno, Italy

Reviewed by:

Livio Vitiello, University of Salerno, Italy
Luigi Capasso, Centro Sanitario Locale Napoli 1 Centro, Italy

Copyright © 2022 Johnson, Jelic, Derksen, Unger, Zeiler, Ziesmann and Gillman. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Lawrence M. Gillman, lawrence.gillman@umanitoba.ca

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.