Skip to main content

ORIGINAL RESEARCH article

Front. Cardiovasc. Med., 11 January 2023
Sec. Atherosclerosis and Vascular Medicine
This article is part of the Research Topic Aortic Stiffness Assessment in Daily Clinical Practice View all 5 articles

The effects of experimental, meteorological, and physiological factors on short-term repeated pulse wave velocity measurements, and measurement difficulties: A randomized crossover study with two devices

\r\nMario Podrug,Mario Podrug1,2Borna &#x;unji&#x;,Borna Šunjić1,2Anamarija BekavacAnamarija Bekavac3Pjero Koren,Pjero Koren1,4Varja &#x;oga&#x;Varja Đogaš5Ivana Mudni&#x;Ivana Mudnić6Mladen BobanMladen Boban6Ana Jeron
i&#x;,*Ana Jerončić1,4*
  • 1Laboratory of Vascular Aging, University of Split School of Medicine, Split, Croatia
  • 2University Department of Health Studies, University of Split, Split, Croatia
  • 3PhD Study Programme, University of Split School of Medicine, Split, Croatia
  • 4Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia
  • 5Department of Psychological Medicine, University of Split School of Medicine, Split, Croatia
  • 6Department of Basic and Clinical Pharmacology, University of Split School of Medicine, Split, Croatia

Background: Large longitudinal studies with repeated pulse wave velocity (PWV) measurements, a direct measure of arterial stiffness, are required to realize the full potential of arterial stiffness in clinical practice. To facilitate such studies it is important to increase the power of a study by reducing within-subject variability of PWV, and to ease the use of a PWV device in clinical settings by minimizing PWV measurement difficulties.

Methods: We systematically investigated experimental setting and meteorological conditions, as well as physiological factors and participant characteristics, to determine whether and to what extent they affected: between- and within-subjects variability of PWV recordings, and measurement difficulties of a particular device. We conducted a 2-week longitudinal block-randomized cross-over study with two blinded observers and two commonly used devices: applanation tonometry SphygmoCor CvMS and oscillometric Arteriograph to assess carotid-femoral (cfPWV) or aortic (PWVao) PWV, respectively. Our sample had uniform and wide-spread distribution of age, blood pressures, hypertensive status and BMI. Each participant (N = 35) was recorded 12 times over 3 visiting days, 7 days apart. On each day, recordings were made twice in the morning (7–10 a.m.) and afternoon (16–18 p.m.). Data were analyzed using multilevel mixed-effects models, separately for each device.

Results: In addition to age and mean arterial pressure (MAP) that strongly affected both cfPWV and PWVao, other significant factors appeared to indicate a measurement approach. cfPWV as a more direct measure of arterial stiffness was additionally affected by hypertension status, outdoor temperature, interaction of MAP with outdoor temperature and the order of visit, with MAP within-subject variability contributing on average 0.27 m/s to difference in repeated measurements at 5°C and 0.004 m/s at 25°C. PWVao measurements derived at a single brachial site were more dependent on age than cfPWV and also depended on personal characteristics such as height and sex, and heart rate; with within-subject MAP variability adding on average 0.23 m/s to the difference in repeated measures. We also found that female sex significantly increased, and recording in afternoon vs. morning significantly decreased measurement difficulties of both devices.

Conclusion: We identified factors affecting PWV recordings and measurement-difficulties and propose how to improve PWV measuring protocols.

1. Introduction

Arterial stiffness is a phenomenon associated with vascular aging that refers to loss of arterial compliance or changes in vessel wall properties (1). Arterial stiffness increases with age and with prolonged exposure to risk factors that accelerate this process (2, 3). Numerous studies have found that increased arterial stiffness is associated with an increased risk of a first or recurrent major CVD event, independent of traditional risk factors, in both disease-specific and population-based samples (46). In addition, arterial stiffness has been shown to improve reclassification of patients at intermediate risk for cardiovascular disease by complementing the information provided by traditional risk factors (4, 5, 79). The potential clinical implication of arterial stiffness measurements in early detection of high-risk individuals (10, 11) and in driving hypertensive patient therapy (12) make arterial stiffness measurements a promising keystone in hypertension management and cardiovascular prevention (13, 14).

Pulse wave velocity (PWV) measurement is considered the simplest, non-invasive, robust, and reproducible method for assessing arterial stiffness, with the carotid-femoral vascular bed regarded as the most easily accessible pathway for aortic PWV measurements (2, 15). Because of the abundance of population data and reference values for the healthy population (16), carotid-femoral pulse wave velocity (cfPWV) recorded with the SphygmoCor CvMS applanation tonometer has been established in the literature as a reference for comparison and is recommended by the ARTERY Society guidelines as a standard against which new PWV devices can be validated (17). Devices that estimate PWV from other vascular beds and are technically less demanding, such as those that estimate aortic PWV (PWVao) from brachial cuff-based waveform analysis recorded at a single site—e.g., oscillometric Arteriograph device, are also commonly used in practice. While both the SphygmoCor CvMS and the Arteriograph device have been verified using invasively recorded aortic PWV (18, 19), their measurements are not interchangeable (2022), likely because they employ different measuring techniques. For this reason, head-to-head comparison between the devices is hard to interpret.

Despite its considerable potential for cardiovascular disease prevention, measurements of PWV have limited use in clinical practice. The updated 2021 ESC Guidelines on cardiovascular disease prevention in clinical practice argues against widespread use of PWV measurement in clinics because of difficulties in measurements and precision of measurements (23). While recommendations for minimizing confounding of arterial stiffness measurements in order to obtain reliable PWV values have been published and are included in study protocols (24), there are additional factors that have been proposed to alter PWV measurement (2428). These factors, that are not controlled for in a protocol, may increase between- and within-subject variability of PWV measurements, lowering the device’s resolution to detect a minimal clinically important change and decreasing precision of PWV measurements, which consequently reduce the power of a study. As demonstrated by the SPARTE study’s low power (12), improving the power of longitudinal studies measuring PWV and reducing PWV-related measurement difficulties (e.g., the need to repeat the measurement) are critical to facilitating large longitudinal studies and improving PWV translation into clinical practice. Aside from clinically relevant PWV changes, factors such as mean blood pressure (MAP), heart rate (HR), different observers, time of day, or outdoor temperature have been implicated as additional sources of PWV variability (24, 25, 2935). While individual factors have been studied in few studies, no study has systematically examined several factors together to assess the independent contribution of each factor while controlling for the others. To minimize the impact of additional factors that significantly affect PWV measurements in a clinical setting it is important to identify such factors and quantify their effects. Furthermore, it is essential to identify and control factors affecting measurement difficulties of a device, such as the need to repeat a PWV measurement, in order to ease the use of devices in clinical setting. Because different PWV devices, particularly those that use different measurement principles, do not necessarily have interchangeable PWV values (2022), it is reasonable to assume that the aforementioned analyses will produce different results and should thus be performed separately for each device. The study had two goals: (a) to identify factors that affected PWV measurements that differed from those controlled in the standard PWV measurement protocol (e.g., meals, smoking, exercise), and to quantify their effects; and (b) to determine which of these factors affects a device’s measurement difficulties (e.g., the need to repeat PWV measurement, or to manually select a signal for analysis), and to what extent. The experimental setting and meteorological conditions, as well as physiological factors and participant characteristics, were systematically assessed as factors. The analyses were performed separately for the two devices that use different measuring techniques—the applanation tonometer SphygmoCor CvMS and the oscillometric device Arteriograph.

To reach our goals we used the study design that yields strong evidence: a block-randomized cross-over longitudinal study with two observers that were blinded to each other’s readings, the largest number of repeated measurements per participant (Nper participant = 12 recordings; Ntotal = 420), uniform distribution of participants by age, sex, BMI and hypertensive status, and multilevel mixed-effects models used in data analysis. All the recordings were performed over 2 weeks. In such a short period of time, clinically relevant changes in vascular biology are not expected, so the variability of PWV during repeated recordings can primarily be attributed to chance and confounding factors.

2. Materials and methods

2.1. Participants

The study enrolled 36 participants aged 20–60 years. Participants were purposively sampled by age, sex, hypertension status (normotensive or hypertensive), and body mass index (BMI, ranging from normal weight to obese) to ensure even distribution across the inclusion criteria (Figure 1). Participants’ hypertension status was established by self-report of physician diagnosis, with all such persons reporting receiving treatment, whereas BMI categories were determined according to the Centers for Disease Control and Prevention classification for adults (36). Exclusion criteria included self-reported arrhythmias, cerebrovascular disease, pregnancy, surgery amputation, oncology disease, psychiatric disease, and infections throughout the trial duration.

FIGURE 1
www.frontiersin.org

Figure 1. Uniform distribution of participants by: (A) Sex, hypertensive status and BMI categories; and (B) age (χ2 = 1.5, p = 0.692).

One person (female, 45 years old, hypertensive and obese) who was initially enrolled in a study was additionally later excluded because she contracted an infection over the course of the study, leaving a total of 35 participants.

The study was approved by the Ethics Committee at the University of Split School of Medicine, and all participants provided written informed consent.

2.2. Study design

This is a single-blind block-randomized cross-over longitudinal study.

The study took place between October 2019 and February 2020 at the University of Split School of Medicine in the Laboratory for vascular aging.

Each participant was recorded 12 times in total over the course of 2 weeks, four times during each of the 3 visit days that were separated by 1 week. On each visiting day, recordings were taken in the morning (7–10 h) and afternoon (16–18 h) by the two observers.

The order of devices—Sphygmocor CvMs and Arteriograph and of observers, was randomized using the block size of 4. The two observers were blinded to each other’s readings.

2.3. PWV measurements

Pulse wave measurements were taken with the two devices that use different measuring techniques—the applanation tonometer SphygmoCor CvMS (Atcor Medical, Sydney Australia) with which we collected cfPWV data and the oscillometric device Arteriograph (TensioMed, Budapest, Hungary) used to collect PWVao data.

The measurements were taken in accordance with the American Heart Association’s recommendations for improving and standardizing vascular research on arterial stiffness (24). The observers performed measurements in a quiet, temperature-controlled room at a comfortable temperature of 21–23°C. The participants rested in the supine position for 10 min before the first PWV measurement to ensure hemodynamic stability. After completion of the series of measurements with one device, participants were asked to stand up, walk around the room, and then rest supine for 10 min to prepare for measurements with the second device. This step was necessary to prevent participants from falling asleep while resting supine for an extended period, especially in the morning. During the measurements, participants were asked not to talk or sleep. All measurements were performed on the right hand (Arteriograph) and the right carotid and femoral artery (SphygmoCor).

Participants were requested to abstain from vigorous exercise and alcohol consumption for at least 24 h prior to a recording session (morning or afternoon). They were also instructed not to eat or drink anything except water or smoke for at least 3 h before any recording session. Those taking vasoactive medicines were advised to continue taking them as usual and not to change the dosage during the study.

Before the start of the study, both observers had received extensive 7-day training during which they performed approximately 40 high-quality measurements under supervision.

To calibrate the pulse wave signals acquired by the SphygmoCor, we obtained brachial blood pressure measurements with the validated oscillometric sphygmomanometer (Welch Allyn Connex ProBP 3400 digital blood pressure monitor with SureBP technology).

We used the subtracted distance method to calculate wave travel distance. The method was chosen over the direct method as per recommendation by the latest guideline (24). A large school divider (Figure 2) was used to measure the distance between the sternal notch and the femoral measurement site, as well as the distance between carotid measurement site and the sternal notch was than subtracted from this distance. The tool was selected because it measures straight-line distance independent of body shapes such as particularly large bellies and/or breasts in obese individuals. It is similar to a sliding caliper, which has been recommended for use when straight-line measurement with a tape measure is not possible (24, 37, 38). However, unlike slide caliper whose slide blades may still impede with the body shape in overweight and obese individuals to some extent, a divider is unaffected by it due to its long arms. We only measured the distance between the carotid and femoral sites during the first visit. Each observer obtained a single distance measurement during this visit. If the measured distances differed between observers, the process was repeated, and if the difference remained after the second round of measurements, the average of the four previous distance measurements was used as the true distance (N = 1 participant).

FIGURE 2
www.frontiersin.org

Figure 2. Measurement of a distance between the sternal notch and the femoral site with a tape (red line) and a school divider (green line).

2.4. Collection of other data

All participants underwent a medical history.

The meteorological data: outdoor temperature, air pressure, and relative humidity, were provided by the Meteorological and Hydrological Service of Croatia’s local office, and used to estimate weather conditions on each visit day and time. The contour plot is used to show the distributions of three meteorological parameters by a visit day (visit 1, 2, or 3) for all of the participants’ visits, with relative humidity and air pressure as x and y dimensions, and temperature as a color coded z-dimension (Figure 3). The graph shows that outdoor conditions on the visit day 3 differed significantly from those on the visit days 1 and 2 (Figure 3).

FIGURE 3
www.frontiersin.org

Figure 3. Meteorological factors during the 3 visit days—distributions of outdoor temperature, air pressure, and relative humidity are shown as contour plots for all the participants’ visits assigned to a particular visit day—1, 2, or 3.

2.5. Sample size consideration

The study employs a multilevel data structure, including 35 groups (participants, level-2) and 12 repeated measurements by a participant (level-1) totaling 420 observations. Because no random slopes are anticipated in any of the multilevel models that we developed, the sample sizes mentioned above (levels 2 and 1) are deemed adequate for estimating unbiased and accurate regression coefficients, variance components, and first level standard errors (39, 40), allowing for models with up to 12 independent variables (41).

2.6. Data analysis

We used descriptive statistics to describe distribution of quantitative (mean and standard deviation or median and IQR, depending the shape of distribution) and qualitative (absolute and relative frequencies) variables. To identify predictors of PWV single readings, or different types of measurement difficulties we employed several multilevel models with random intercept. Depending on the type of a dependent variable we used multilevel mixed-effects generalized linear models for continuous dependent variables like PWV readings, mixed-effects logistic regression models for dichotomous dependent variables like the occurrence of marginal-quality signals or manual signal selection, and mixed-effect Poisson regression for count data like the count of repeated attempts to record PWV values due to low-quality of a captured signal. All of the models were run with the robust estimator, which is resistant to certain types of misspecification in multilevel models such as heteroscedasticity or deviation from normality (42, 43), and sensitivity analysis was performed with the maximum likelihood (ML) method without robust estimator.

Each model was built in two steps. The experimental setting variables—order of visit, time of day, first device used in a session, and observer, meteorological variables—outdoor temperature (°C), air pressure (Pa), and relative humidity (%), and participants’ characteristics—age, sex, BMI, hypertension status, MAP, SBP, DBP, HR—were all investigated for their relationship to a dependent variable by a simple multilevel regression analysis. Those independent variables that were associated with dependent variable at the p < 0.2 significance level, entered into multiple multilevel regression model. For independent variables that were non-significant in a multiple model, their contribution to the model (pseudo R2) was investigated further to decide on their inclusion in the final model.

The metrics for assessment of individual variability of PWV readings was determined by considering the multilayered data structure. The average within-subject CV was calculated using the root mean square method (44). The intraclass correlation coefficient (ICC) was calculated by using random-effects model to estimate correlations between average measurements made on the same participant. As outliers may significantly affect this measure, we excluded the severe outliers from the calculation (45).

3. Results

The study included a total of 35 participants. Recorded PWV values ranged from 4.5 to 10.8 m/s for cfPWV and 5.5–15.8 m/s for PWVao. The validation sample also covered wide ranges of brachial blood pressures, age and BMI that were uniformly distributed (Figure 1). Participants’ characteristics are shown in Table 1.

TABLE 1
www.frontiersin.org

Table 1. Characteristics of participants, N = 35.

The difference in distance between the carotid and femoral sites measured with a tape vs. a school divider strongly correlated with the level of obesity as evaluated by BMI (r = 0.79, P = 0.020). Thus, the school divider was effective in removing this effect of BMI.

Overall, the coefficient of variation for within-subject variability was 9.9% (95% CI 9–11%) and 5.3% (95% CI 5–6%) for cfPWV and PWVao measurements, respectively; while ICC for within-subject average cfPWV measurements was 94% (95% CI 91–97%) and 96% (95% CI 94–98%) for PWVao measurements.

3.1. Factors significantly affecting PWV measurements

Table 2 lists the factors with a significant effect on PWV measurements, that were identified among experimental conditions, physiological and meteorological factors, as well as characteristics of the participants that we assessed in this study.

TABLE 2
www.frontiersin.org

Table 2. Factors that significantly affect PWV measurements, and expected between- and within-subject differences in PWV measurements that are due to a factor’s observed range in a sample and its within-subject variability.

In both the cfPWV and PWVao models, the most prominent effects to which the largest difference in predicted PWV margins was attributed were age and MAP, in that order. The increase in PWV values with a 1-year increase in age was twice higher for PWVao than cfPWV measurements (Table 2, see 95% CI for B; Figures 4A, B). However, we could not directly compare the effects for MAP as the factor was involved in a significant interaction with outdoor temperature in the cfPWV model, which hampered interpretation of its main effect (Figure 4C).

FIGURE 4
www.frontiersin.org

Figure 4. Scatter plots of (A) cfPWV measurements vs. age, and (B) PWVao measurements vs. age; (C) moderation interaction of the outdoor temperature on the relationship between cfPWV values and MAP; lines connect predictive margins of the multilevel regression model with 95% CI.

As for the meteorological factors, only the outdoor temperature had a significant effect on cfPWV measurements. In cfPWV model, as mentioned earlier, outdoor temperature was involved in the interaction with MAP, suggesting that it modifies the relationship between cfPWV and MAP (Figure 4C). PWVao measurements were not influenced by any outdoor meteorological factor.

Except for the order of visit in the cfPWV model—notably the comparison of 2nd to 1st visit values, no other experimental factor was associated with differences in cfPWV or PWVao measurements.

Increased values of PWVao measurements were also associated with increased values of BMI and HR, and a female sex, whereas in the cfPWV model it was hypertensive status that was found to significantly increase cfPWV.

During the development of multilevel mixed-effects models we also assessed if there was a significant interaction between sex and age. After including an interaction term between sex and age in the full multivariate models of both SphygmoCor and Arteriograph, and controlling for menopause status, we discovered that the interaction between age and sex is not significant (p ≥ 0.365).

Finally, after developing multilevel mixed-effects models that aimed to identify factors influencing values of PWV measurements, we also evaluated which, if any, participants’ characteristics are related to variability of repeated measurements in a person. We found for both cfPWV (Pearson’s r = 0.51, p = 0.002) and PWVao (r = 0.34, p = 0.047) measurements that older age was associated with wider range of repeated PWV measurements observed in a person, whereas BMI, hypertension status or sex were not associated with this variability. However, we did find significantly larger variability of within-subject PWV measurements in menopausal than in women with menstrual cycle, for both devices (P ≤ 0.035, Mann-Whitney test). Moreover, for women who menstruate, within-subject PWV variability was comparable to men (P ≥ 0.310). In addition, we also assessed if the order of visit, the only experimental condition significantly affecting cfPWV values, is associated with decreasing variability of cfPWV measurement in a person and found this was not the case (repeated measurements ANOVA, P = 0.781).

Regarding the repeated measurements defined by the final models depicted in Table 2, within-subject cfPWV on average deviated by 0.73 m/s (95% CI 0.64–0.83), whereas PWVao deviated by 0.84 m/s (95% CI 0.58–1.20). These models described 59 and 67% of the repeated variability, respectively.

3.2. Factors significantly affecting difficulties in measuring PWV

Next, we wanted to know which factors influenced difficulties in measuring PWV with each device. We focused on the following difficulties: (a) the number of repeated measurements as a result of the SphygmoCor’s pulse wave velocity signal failing the quality control, (b) the possibility of observing the marginal quality signal by SphygmoCor with the coefficient of variation for cfPWV estimation between 6 and 10%, or (c) the Arteriograph’s oscillometric signal being manually selected for analysis (Table 3).

TABLE 3
www.frontiersin.org

Table 3. Predictors of the measurement difficulties for Arteriograph and SphygmoCor devices.

As opposed to the automatic selection of the oscillometric pulse wave signal by Arteriograph device, the manual signal selection is time-consuming and subject to uncertainty. In total, we had to manually select a signal for analysis in 78 (19%) of the Arteriograph recordings. We did not find, however, that manual selection affected PWVao values when this factor was added as independent variable to the simple (p = 0.438), or final (p = 0.276) multilevel model. The results demonstrate that it is very likely that the Arteriographs’s oscillometric signal will be manually selected for analysis in a female participant. In fact, manual adjustment was required at least once for 11 (65%) of the women, with five women requiring it on ≥8 instances out of 12 measurements. In contrast, just five males (28%) required this modification on 1–3 occasions. Measuring in the afternoons was strongly to moderately associated with a lower chance of manual adjustment, reducing the odds ratio for it by 77% (95% CI from 46 to 90%). Finally, a chance for manual adjustment differed significantly between the measurers by increasing OR for the measurer 2 by 0.91 (95% CI 0.23–1.95).

In terms of the SphygmoCor, with which we were able to record all 12 measurements for each participant, we had to repeat a measurement 135 (32%) of the time. Female sex increased the incidence rate ratio (IRR) of a repeated measurement by 23% (95% CI 1–50%), whereas afternoon recording time and 3rd vs. 1st visit decreased IRR by 12% (95% CI 3–21%) and 14% (95% CI 4–27%), respectively.

We also discovered that the same two factors—afternoon recording time and 3rd vs. 1st visit—decreased the odds of a signal with marginal quality, which we observed in 95 (23%) of measurements, by: 40% (OR 95% CI −3 to 65%) and 50% (95% CI 1–74%), respectively. When the marginal quality of a signal was added as independent variable to the simple and final multilevel model we found that it increased cfPWV values by on average 0.37 m/s (95% CI 0.16–0.58, p = 0.001).

4. Discussion

We systematically examined a number of experimental and meteorological conditions as well as physiological factors and participants’ characteristics to find if, and to what level, they affect (a) recorded PWV values, and (b) measurement difficulties associated with this recording. PWV values were repeatedly collected from the enrolled participants over the course of 2 weeks during which no clinically relevant change in PWV values is expected. The analyses were done separately for measurements acquired with two validated devices: cfPWV measurements acquired with applanation tonometry device SphygmoCor CvMS and PWVao values recorded with oscillometry Arteriograph device.

We utilized the study design that provides the strong evidence: block-randomized, cross-over, longitudinal study with as many as 12 repeated measurements per participant per device, recorded with observers blinded to each other’s readings. Furthermore, our validation sample exhibited a reasonably wide range of PWV, age, BMI and brachial blood pressures values, and uniform distributions across age, sex, BMI, and hypertension status. Given that uniform distribution puts less emphasis on the center of the distribution and more on its extremes, it produces more precise validation estimates and is thus preferable as validation sample to a sample representative of an underlying population (46).

There haven’t been many studies that look at the short-term repeatability or reproducibility of PWV measurements (4751), with studies reporting from 2 to 6 repeated measurements per participant. Despite the fact that we recorded the most repeated PWV measurements per participant (N = 12), and that our sample had a reasonably wide range of PWV and PWV determinants, which tend to increase observed variability of PWV measurements, the agreement of repeated PWV measurements estimated in our study was comparable to what has been reported in the literature. Grillo et al. estimated within-subject CV, and ICC for cfPWV values recorded with SphygmoCor CvMS device in patients of predominantly normal weight who were hospitalized for suspected coronary artery disease. They used six repeated measurements per person and reported comparable metrics to our study with the CV of 9.5 (95% CI 7.7–11.0), and ICC of 0.85 (95% CI 0.78–0.90) (48). Our ICC value for the cfPWV measurements was also comparable to that reported by studies that were performed on patients with peripheral arterial disease (52, 53). As for the Arteriograph’s PWVao measurements, Li et al. measured PWVao at 3 timepoints during a day in 70 participants including healthy young and elderly participants, and patients with cardiovascular disease treated in outpatient clinic; and reported CV of 6.1%, which is comparable to our study (54). Similarly, Ring et al. reported CV of 9.3 and 9.6% in 51 healthy non-smoking participants for Arteriograph’s PWVao and SphygmoCor’s cfPWV, respectively (55).

4.1. Factors affecting PWV readings

4.1.1. Age

Age was the factor with the largest effect on cfPWV and PWVao measurements, followed by MAP. This is consistent with the data from other studies that show a strong dependence of PWV on age and MAP (16, 24, 56, 57). On average, age accounted for approximately 2–3 m/s PWV difference between subjects, with apparently stronger effect of age on PWVao values: cfPWV increased by 0.4 m/s (95% CI 0.2–0.6), and PWVao by 0.8 m/s (95% CI by 0.6–1.0) every 10 years.

Other studies utilizing the SphygmoCor CvMS device reported comparable effects of age on cfPWV measurements ranging from: 0.2 m/s per 10 years (58), to 0.3–0.4 m/s (59), to somewhat larger effects of around 0.7–0.9 m/s reported by the same group of authors (16, 60). While age was identified as the strongest determinant of PWVao too (61), studies that investigated factors influencing Arteriograph’s PWVao measurements did not reported comparable, unstandardized regression metrics. However, the study that investigated PWVao measurements recorded with oscillometric Vicoder device reported a comparable effect of 0.4–1.0 m/s per 10 years (62).

While we may assume that age remained constant during the 2 weeks of the study and thus did not contribute to an absolute change in a person’s repeated measurements, we also discovered that older age increased the variability of repeated measurements for both cfPWV and PWVao, thereby increasing measurement error. Grillo et al. discovered that patients with increased arterial stiffness had greater variability in repeated PWV measurements acquired with various cfPWV-estimating devices (48). This relationship is thought to be due to the fact that PWV is defined as a ratio of traveled distance to pulse wave transit time (PWTT), in which case a small difference in PWTT can cause a relatively large difference in PWV in subjects with high arterial stiffness, whereas this difference is negligible in subjects with normal arterial stiffness. As age is the strongest determinant of PWV, the association reported by Grillo et al. corroborates the association between age and within-subject short-term PWV variability that was reported in our study. Because both of the devices we tested estimate PWTT: SphygmoCor by determining pulse transit time from carotid to femoral location, and Arteriograph by determining the time difference between the first systolic wave and the second reflected wave; we found the said association for both devices. This finding suggests that when patients are monitored for longitudinal changes in PWV, it would be advantageous to increase the number of measurements in older persons during one visit (from 2 to 3–4) to improve precision of estimated PWV.

4.1.2. MAP and outdoor meteorological factors

The second strongest effect on PWV recording was due to MAP, which is considered the most significant physiological variable affecting arterial stiffness (30, 31, 34). With the increase of MAP, vessels stiffen, meaning that the effect of this variable on repeated PWV measurements should be considered whenever the measurements are taken under different BPs. MAP on average accounted for approximately 1–2 m/s PWV difference between subjects in our study, with PWVao increasing by 0.2 m/s (95% CI 0.10–0.25) for every 5 mmHg. This is comparable to the effect estimated with Vicorder, another oscillometric device: 0.05–0.20 m/s per 5 mmHg (62). Considering within-subject variability of MAP in our study, on average 0.23 m/s (from 0.10 to 0.33 when uncertainty in estimates is considered) discrepancy in repeated PWVao measurements may be assigned to MAP variations.

The expected changes in cfPWV due to MAP or outdoor temperature changes were less obvious due to the significant interaction between outdoor temperature and MAP, demonstrating that outdoor temperature moderates the relationship between cfPWV and MAP. The expected difference between predicted cfPWV assigned to lowest and highest observed MAP and adjusted for other factors at 5°C was 2.62 m/s, but at 25°C this difference was only 0.04 m/s. Individual differences in repeated measurements that are due to MAP variations are predicted to be 0.27 m/s (uncertainty 0.24–0.30) at 5°C and 0.004 m/s (0.004–0.005) m/s at 25°C. Interestingly, there was no significant main effect of outside temperature or its interaction with MAP for PWVao measurements.

While the negative relationship between outdoor temperature and BP readings has been observed in many studies (6367), similar relationship was hypothesized for arterial stiffness, but studies reported inconsistent results. Di Pilla et al. reported that in an unadjusted regression analysis, cfPWV recorded by SphygmoCor was weakly and inversely associated with outdoor temperature, but not in a multiple regression analysis that controlled for age, BMI, SBP, DBP, daylight hours, O3, CO, and N2O (25). In repeated measures ANOVA analysis, Kita et al. demonstrated considerable sessional change of an arterial stiffness index—arterial velocity pulse index, with higher stiffness observed during a summer (26). The omission of a significant interaction term between temperature and MAP in these models may explain inconsistencies, as exclusion of the term from cfPWV model in our study also resulted in a non-significant main effect of temperature, while a simple correlation also showed that cfPWV is inversely associated with temperature. While the mechanism underlying this relationship is beyond the scope of our study, it has been proposed that cold-induced sympathetic activation may account for the dependence of cfPWV readings on outdoor temperature in conditions where the room temperature is constant (25, 68). Having said that, it appears that at lower outdoor temperatures, resting time in supine position in the temperature-controlled room might be extended beyond 10 min to allow for temperature accommodation, or alternatively, repeated measurements might be taken in a season with higher outdoor temperatures, such as those around 25°C. More research with different adaptation times is needed to determine whether temperature accommodation is indeed responsible for the observed effect.

4.1.3. HR

Aside from the effect of outdoor temperature on PWV measurements, there was also a disparity in the effect of HR between the cfPWV and PWVao models. This physiological factor had a moderate effect on PWVao readings explaining on average 1.45 m/s difference in PWVao between the subjects with PWVao increasing on average by 0.2 m/s (95% CI 0.02–0.40) per 10 bpm. The effect is similar to that reported by Tan et al., who used a hybrid applanation tonometry/oscillometric device SphygmoCor XCEL device and found an increase of cfPWV of 0.11–0.28 m/s per 10 bpm (35). In addition, individual variability in HR in our study accounted on average for 0.12 m/s (uncertainty, 0.01–0.27) discrepancy in repeated PWVao measurements. Considering these effects, PWVao is expected to have minimal physiologically relevant changes for small changes in HR, while larger changes in HR may be viewed as leading to considerable differences in PWVao. However, we did not observe a significant effect on cfPWV readings.

While current PWV estimation guidelines recommending that HR be considered as a confounding factor, there is still disagreement about the effect of HR on aortic PWV measurements, particularly considering that short-term studies investigating the relationship between heart rate and arterial stiffness reported varying results, including a positive, negative, and no association (24). O’Rurke et al. proposed that the apparent association between aortic PWV and HR might be due to systematic error introduced by certain devices when estimating such PWV (32), whereas Salvi et al. demonstrated, on data collected with applanation tonometry device PulsePen, that the said association was cofounded by the ventricular ejection time (69). Tan et al., however, used hybrid SphygmoCor XCEL and demonstrated BP-independent effects of HR on cfPWV (35). In line with the O’Rurke’s considerations, our results on two different devices suggest that the usage of devices with differing PWV measurement techniques might be the source of this disparity in findings. While many studies employing SphygmoCor CvMS or applanation tonometry technique in general reported no significant change in cfPWV with HR (60, 69, 70), studies that estimated aortic PWV using Doppler method (71), Arteriograph’s oscillometric technique (61) or a hybrid applanation tonometry and oscillometric technique such as the one employed by SphygmoCor XCEL device (35) found independent HR effect on PWVao.

4.1.4. Experimental conditions

Out of all the experimental conditions tested only the visit order affected the PWV measurements. Specifically, whereas the order of visits had no effect on the PWVao measurements, the cfPWV measurements acquired during the second visit were on average 0.23 m/s (95% CI 0.03–0.43) lower than those of the first visit. However, no significant difference was found when the cfPWV data of the third visit were compared with those of the first visit. One possible explanation for the lack of a trend on the third visit is a confounding of this effect by outdoor temperature. Because outdoor temperature was identified as an important factor influencing cfPWV measurements, more pronounced meteorological changes on the third visit likely masked the effect of a visit order. In particular, for some subjects, the outdoor temperature varied by 8–10°C between the third and the other two visits.

The discovery of lower cfPWV values during the second visit may suggests that, despite receiving the amount of training recommended by current guidelines (24), both observers may have lacked some expertise in using SphygmoCor CvMS during the first visit. However, we did not observe a decrease in the within-subject variability of cfPWV measurements with increasing order of visits, as would be expected if the effect of poor training was present. Furthermore, Grillo et al. have shown that the 2-week training period is sufficient to achieve acceptable to excellent agreement of PWV recordings for various devices including SphygmoCor CvMS (48) and, as previously discussed, we have shown that the agreement of repeated cfPWV measurements estimated in our study was comparable to that reported by Grillo et al. Elliot et al. studied the influence of training on the repeatability of cfPWV values as well, but the authors assessed a hybrid SphygmoCor XCEL device with different mode of operation for which training differs (28).

Alternatively, the higher values of cfPWV during the first visit could point toward the white coat effect on arterial stiffness (72, 73). Indeed, the first measurement in our study was considerably higher than the second during the first visit cfPWV measurement series (median difference 0.35 m/s, 95% CI 0.05–0.65), and was also higher than the first measurement of the second visit (0.60 m/s, 95% CI 0.2–1.0). However, Barochiner et al. in an unadjusted analysis comparing isolated office uncontrolled hypertensive participants with sustained normotensive estimated much larger white coat effect on cfPWV with a median difference of 1.2 m/s (73). When we looked at SBP, we also found significant differences between the said measurements (p ≤ 0.015; 1st measurement in first visit was on average higher for 3.3 mmHg, 95% CI 0.6–6.0 than 2nd, and for 3.8 95% CI 1.0–6.5 than 1st measurement in second visit), but these differences are not large enough to be classified as white coat effect. We also found no difference in DBP between these measurements (p ≥ 0.422). A clinically significant white-coat effect is defined in terms of BPs as an office or clinic blood pressure exceeding the daytime ABPM by 20 mm Hg systolic or 10 mm Hg diastolic, either in the absence or presence of antihypertensive drug treatment (74). Thus, while the whitecoat effect, which describes a transient or persistent alerting reaction observed in the majority of patients, was likely present in our sample, the magnitude of it was insufficient to justify the first measurement discartion.

We did not find that time of day or different observers (conditional on observers having the same volume of training) affected cfPWV or PWVao measurements although the current guideline on PWV estimation recommends that repeated/follow-up measurements should be taken at the same time of day, preferably with the same observer (24). Several studies performed on different populations: young healthy volunteers (29), women with uncomplicated pregnancy (33), or healthy individuals of different ages and patients with heart disease (54) corroborate our result on lack of circadian variation in PWV measurements, whereas the study that reported increase in cfPWV with time of day revealed that diurnal PWV changes lost significance after adjustment for BPs suggesting that changes in arterial stiffening are mediated through changes in BP (75). As a result of the findings, future study protocols for follow-up PWV measurements could be simplified, as it is not necessary to measure cfPWV at the same time of day or with the same observer, provided that the quantity of training is adequate and comparable.

4.1.5. Participant characteristics: Sex, height, and hypertensive status

The differences in the PWV models of the two devices included participant characteristics such as sex and height which had a significant effect on PWVao, but not on cfPWV measurements; and hypertensive status, which on average increased cfPWV in hypertensive participants by 0.44 m/s but did fect PWVao measurements.

Female sex on average increased PWVao by 1.56 m/s, whereas height explained on average 2.14 m/s difference in PWVao measurements between the subjects, with one cm of height increasing PWVao by 0.06 m/s (95% CI 0.02–0.09).

Sex, with higher values of PWVao in women compared to men, was also identified as significant factor in another study investigating Arteriographs’ PWVao measurements (61). However, while reports on the relationship between sex and central PWV measurements that were taken by devices other than Arteriograph were varied, all studies including those utilizing oscillometric devices reported either greater values of central PWV in men (16, 59, 60, 62, 7678) or no association with sex (69, 7982). Thus, it appears that higher values of PWVao measurements in women may be specific to Arteriograph device. Contrary to PWVao measurements, we did not find that cfPWV measurements were associated with sex. Vermeersch et al. estimated peripheral and central PWV with applanation tonometry in a large healthy, middle-aged population and concluded that while peripheral, carotid PWV measurements were associated with sex this was not the case with central arterial stiffness parameters such as cfPWV (80). Also, Reference Values for Arterial Stiffness’ Collaboration in 2010 did not find significant differences between sexes in cfPWV while controlling for an age and MAP (57). Although cfPWV was markedly higher in males, the presence of male gender was also accompanied by marked differences in age and BP. After correction for age and MAP, the authors found negligible influence of gender on cfPWV (0.1 m/s difference, P = 0.04) and proceeded with the definition of the reference value population by including all untreated participants, regardless of sex. Similarly, sex was not identified as significant predictor of cfPWV in the multivariable linear regression models controlling for age, MAP, HR in the study by Mitchell et al. (83) which is based on apparently healthy Framingham Heart Study offspring cohort (83). Focusing solely on SphygmoCor’s cfPWV measurements, the results are contradictory, with more studies reporting that in multivariate linear regression models, cfPWV increases with age similarly for both sexes (31, 8082), others revealed that men have higher cfPWV values ranging from 0.27 to 0.72 m/s (16, 59, 60). We discovered no significant interaction between sex and age for either device.

As for the effect of height, similar to Jatoi et al. who also investigated Arteriograph’s PWVao measurements, we found an inverse correlation between PWVao and height (data not shown). However, while in our final multiple model PWVao increased with the increase in height, in Jatoi’s multiple model the association did not reach significance (61). Furthermore, our estimate of the regression coefficient of height was positive; similar to the estimates from the simple regression model developed by Mellin et al. on Vircorder measurements (62) and multiple regression model developed on PulsePen measurements in children (84).

4.1.6. Overall about PWV models

Overall, the findings suggest that SphygmoCor’s cfPWV values are more sensitive to the state of the arterial tree because, in addition to age and MAP, they are also dependent on hypertensive status, the interaction between MAP and outdoor temperature, outdoor temperature, and visit order; whereas Arteriograph’s PWVao values are more dependent on individual characteristics such as sex, height, and age as they are more heavily dependent on age than cfPWV.

It should also be noted that our findings are device-specific and cannot be generalized to other seemingly similar techniques, such as the oscillometric Mobil-O-Graph, which calculates PWV using a formula, because the factors affecting within-subject PWV variability would obviously differ.

4.2. Factors affecting measurement difficulties

The measurement difficulties appeared relatively frequently: from 19% of cases in which Arteriograph’s oscillometric signal had to be manually selected for analysis, to over 24% of cases in which SphygmoCor’s pulse wave signal was of marginal but acceptable quality (with a coefficient of variation for cfPWV estimates ranging from 6 to 10%), to 32% of cases in which SphygmoCor’s recordings had to be repeated. While all of these difficulties are time-consuming, we also found that one of them—a marginal quality of SphygmoCor’s signal, affected accuracy of estimated cfPWV values by raising cfPWV values on average by 0.37 m/s (95% CI 0.16–0.58 m/s). Concerning the difficulty in manually selecting the Arteriograph’s signal, which increases the uncertainty of PWVao estimation and could be expected to affect the accuracy of PWVao readings, we did not find that it was associated to a change in PWVao levels.

All of aforementioned measurement difficulties were reduced when PWV measurements were performed in the afternoon (16–18 h) compared to the morning (7–10 h) sessions. The effect of time of day on need to manually select Arteriograph’s signal was strong with afternoon session reducing the OR for automatic selection by on average 75%, and reducing the probability of the event from 23% during morning sessions to 6% in the afternoon. The time of day also had moderate effect on a need to repeat a SphygmoCor measurement by reducing its IRR in the afternoon measurements on average by 12%. Finally, the OR for the marginal quality of SphygmoCor’s signal reduced by 40% in the afternoon, with a probability of such a signal decreasing from 26% during mornings to 19% in the afternoon. As time of day did not show significant effect on absolute PWV values of either cfPWV or PWVao, just by performing measurement in the afternoon measurement difficulties could be significantly reduced.

Sex was another factor that affected measurement difficulties for both devices. It strongly increased the OR of manual selection of a Arteriograph’s signal by 51 times, and also increased IRR of repeated measurements by SphygmoCor by 1.23 times. The difficulties we observed in obtaining PWV estimation for female participants with both devices might be attributed to men being more likely prototype examinees due to the menstrual cycle’s effect on PWV recordings in women, which, as a result, would make signal acquisition and processing suboptimal for women. However, because the literature describes a validation sample rather than a developmental sample for prototypes, and the manufacturers do not provide a description of developmental sample, there is a lack of evidence to support or refute this assumption.

We also found that the order of visits, which affected repeated cfPWV measurements, affected the occurrence of measurement difficulties with the SphygmoCor too, in such a way that both the need for repeated measurement and the occurrence of a signal with marginal quality were significantly reduced during the third visit compared with the first visit, whereas the frequency during the second visit was comparable to that during the first visit. So it seems that in terms of measurement difficulties with SphygmoCor, there is still a learning curve to be observed in the first 2 weeks.

Finally, while inter-observer differences in PWV readings are not expected for oscillometric devices nor were observed in our study, we show that the need for manual selection of the Arteriograph’s signal is observer-dependent with one observer increasing the odds of it by 91%. Whether this difference between observer is due to positioning or adjusting the cuff should be explored in further studies.

Considerations about the supine and sitting positions with Arteriograph.

While we did not examine the effect of supine and sitting positions on Arteriograph’s PWVao measurements, Arteriograph is frequently used in clinic in a sitting position. Nurnberger et al. estimated the mean difference in PWVao between supine and sitting positions to be −0.18, with the limits of agreement ranging from −1.55 to 1.21 (85). Such wide limits include differences of more than 1 m/s thus demonstrating that PWVao values recorded in two different positions are not the same and only one position, preferably supine, should be used when assessing PWVao.

4.3. Limitations

Potential limitation of our study is referred to the pre-training of observers. Despite providing observers with the necessary pre-training, we discovered a learning curve with the SphygmoCor device, as measurement difficulties were significantly reduced during the third visit compared to the first. Furthermore, we also discovered that repeated cfPWV measurements recorded during second visit were on average 0.23 m/s lower than those recorded during the first visit, indicating that there may be a learning curve affecting cfPWV accuracy too, but we were unable to show this tendency for measurements collected during the third visit compared to first. Nonetheless, even if this learning curve affected repeated measurement accuracy, we do not expect it to have a significant effect on our results: the estimated difference in cfPWV between second and first visit is not large, we did not find that variability of repeated measurements taken during one visit was related to visit order, and we reported comparable agreement between repeated measurements to a study that reported this agreement using observers for which it proved they received a sufficient training period (48). In addition, estimated decrease in within-subject cfPWV measurements during 2nd vs. 1st visit was just −0.03 m/s (uncertainty −0.25, 0.20).

To capture short-term variability of PWV, we monitored within-subject PWV changes for 2 weeks only. Consequently, we were not able to control an effect of menstrual cycle on arterial stiffness by studying all women who still have menstrual periods at a similar phase in the menstrual cycle as this would imply that repeated measurements are also taken at similar phase of the cycle, which would prolong the monitoring period. However, we do not expect that effect of menstrual cycle substantially affected PWV variability in young women as we found significantly larger variability of within-subject PWV measurements in menopausal women than in women with menstrual cycle, for both devices (P ≤ 0.035, Mann-Whitney test). Moreover, for women who menstruate within-subject PWV variability was comparable to men (P ≥ 0.310).

While the study included 35 participants, we developed multilevel models with 12 repeated measurements per participant for a total of 420 measurements, which considerably increased the study’s power (86). Furthermore, as indicated in the methodology section, the sample size consideration for our model choice allowed for up to 12 independent variables, and we also demonstrated that our estimates of the effects of factors influencing PWV readings were realistic, whenever we could compare our estimates to those estimated in other studies.

One potential limitation of our study was mitigated with the choice of cross-over randomized design. Although we did not directly compare the devices for reasons explained before, it was important that devices be used in a comparable setting as there was a possibility that measurements taken with the first device in a series may affected measurements taken with the second device and that an identified significant factor for a device may be due to the fact that that device is always applied second in the measurement series. To account for this effect, we randomized the order of devices in a measurement series and developed multilevel regression models that showed that the identity of the first device used in a measurement series for a person had no effect on PWV measurements, supporting the assumption of comparable settings.

Finally, because the PWV measurements were taken within 2 weeks, we were unable to investigate any seasonal effects on the PWV measurements. Given that blood pressure can be significantly lower in the summer compared to the winter, it remains to be seen whether the short-term estimates made in this study are sensitive to the season in which the recordings were taken.

5. Conclusion

In conclusions, we systematically assessed a large number of experimental, meteorological, physiological factors and personal characteristics to identify those that affect PWV measurements and contribute to differences in short term repeated measurements. We quantified these effects separately for the two devices that use different measurement techniques, using study design that provides strong evidence.

We discovered that increasing age increases not only the values of cfPWV and PWVao but also the variability of their repeated measurements, suggesting that in older people precision of measurement should be increased, possibly with the use of 3–4 measurements in a series instead of only 2.

For SphygmoCor’s cfPWV measurements, we also found a significant interaction between MAP and outdoor temperature, as well as significant mean effect of temperature, which could lead to significant fluctuations in short-term repeated measurements. Recording cfPWV during a season with a higher outdoor temperature (e.g., 25°C) when differences in MAP result in smaller differences in cfPWV may reduce some of the short-term fluctuations. Also, it should be further investigated if prolonging resting time during periods with low outdoor temperature might help with reduction of short-term fluctuations.

Time of day or different observers who received the same amount of pre-training did not affect cfPWV or PWVao measurements. However, measurement difficulties occurred significantly less frequently in the afternoon for both instruments. To facilitate future longitudinal studies, it would be advisable that PWV is measured in the afternoon whenever possible, not necessarily with the same observer.

For both devices, we found a relationship between a measurement difficulty and female sex. Whereas, the number of retaken measurements with SphygmoCor was moderately increased in women, the association with sex was very strong for manual signal selection with the Arteriograph device which was much more common in women than in men. In addition, the PWVao measurements by Arteriograph revealed that PWVao values were on average significantly higher in women than in men. This is in contrast to other devices that found higher PWV values for men, or no association with sex. Overall, the findings indicate that devices’ design may be suboptimal for women, with a possible systematic bias in Arteriograph’s measurements.

The differences in factors affecting the PWV measurement in the two models most likely reflect differences in the measurement techniques of the two devices. In addition to age and MAP, cfPWV measurements which are considered a more direct measure of arterial stiffness were also influenced by hypertension status, the interaction MAP-outside temperature, temperature and the order of visits. PWVao values which were estimated from a single site were additionally influenced by patient characteristics such as sex, height, and HR, with higher PWVao values in women being specific to the Arteriograph device.

Data availability statement

The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

The studies involving human participants were reviewed and approved by the Ethical Committee of University of Split School of Medicine. The patients/participants provided their written informed consent to participate in this study.

Author contributions

MP and AJ conceived and designed the study, analyzed the data, and wrote the draft of the manuscript. MP, BŠ, AB, PK, VĐ, and IM participated in data collection. MB, IM, and AJ supervised the data collection and the findings of the study. All the authors interpreted the data and approved the final version of the manuscript.

Funding

This study was funded by the Croatian Science Foundation (No. IP-2018-01-4729). The funder had no role in the design and conduct of the study; collection, management, analysis and interpretation of the data; preparation, review or approval of the manuscript; or decision to submit the manuscript for publication.

Acknowledgments

We thank our participants for their time and commitment to the study.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Laurent S, Boutouyrie P. Arterial stiffness and hypertension in the elderly. Front Cardiovasc Med. (2020). 7:544302.

Google Scholar

2. Laurent S, Cockcroft J, Van Bortel L, Boutouyrie P, Giannattasio C, Hayoz D, et al. Expert consensus document on arterial stiffness: methodological issues and clinical applications. Eur Heart J. (2006) 27:2588–605. doi: 10.1093/eurheartj/ehl254

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Safar ME, Blacher J, Pannier B, Guerin AP, Marchais SJ, Guyonvarc’h PM, et al. Central pulse pressure and mortality in end-stage renal disease. Hypertension. (2002) 39:735–8.

Google Scholar

4. Ben-Shlomo Y, Spears M, Boustred C, May M, Anderson SG, Benjamin EJ, et al. Aortic pulse wave velocity improves cardiovascular event prediction: an individual participant meta-analysis of prospective observational data from 17,635 subjects. J Am Coll Cardiol. (2014) 63:636–46. doi: 10.1016/j.jacc.2013.09.063

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Vlachopoulos C, Aznaouridis K, Stefanadis C. Prediction of cardiovascular events and all-cause mortality with arterial stiffness: a systematic review and meta-analysis. J Am Coll Cardiol. (2010) 55:1318–27.

Google Scholar

6. Zhong Q, Hu MJ, Cui YJ, Liang L, Zhou MM, Yang YW, et al. Carotid-femoral pulse wave velocity in the prediction of cardiovascular events and mortality: an updated systematic review and meta-analysis. Angiology. (2018) 69:617–29. doi: 10.1177/0003319717742544

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Mattace-Raso FU, van der Cammen TJ, Hofman A, van Popele NM, Bos ML, Schalekamp MA, et al. Arterial stiffness and risk of coronary heart disease and stroke: the Rotterdam Study. Circulation. (2006) 113:657–63.

Google Scholar

8. Mitchell GF, Hwang SJ, Vasan RS, Larson MG, Pencina MJ, Hamburg NM, et al. Arterial stiffness and cardiovascular events: the Framingham Heart Study. Circulation. (2010) 121:505–11.

Google Scholar

9. Sehestedt T, Jeppesen J, Hansen TW, Rasmussen S, Wachtell K, Ibsen H, et al. Risk stratification with the risk chart from the European Society of Hypertension compared with SCORE in the general population. J Hypertens. (2009) 27:2351–7.

Google Scholar

10. Chirinos JA, Segers P, Hughes T, Townsend R. Large-artery stiffness in health and disease: JACC state-of-the-art review. J Am Coll Cardiol. (2019) 74:1237–63. doi: 10.1016/j.jacc.2019.07.012

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Laurent S, Boutouyrie P, Cunha PG, Lacolley P, Nilsson PM. Concept of extremes in vascular aging. Hypertension. (2019) 74:218–28.

Google Scholar

12. Laurent S, Chatellier G, Azizi M, Calvet D, Choukroun G, Danchin N, et al. SPARTE study: normalization of arterial stiffness and cardiovascular events in patients with hypertension at medium to very high risk. Hypertension. (2021) 78:983–95. doi: 10.1161/HYPERTENSIONAHA.121.17579

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Boutouyrie P, Chowienczyk P, Humphrey JD, Mitchell GF. Arterial stiffness and cardiovascular risk in hypertension. Circ Res. (2021) 128:864–86.

Google Scholar

14. Bonarjee VVS. Arterial stiffness: a prognostic marker in coronary heart disease. available methods and clinical application. Front Cardiovasc Med. (2018) 5:64. doi: 10.3389/fcvm.2018.00064

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Tillin T, Chambers J, Malik I, Coady E, Byrd S, Mayet J, et al. Measurement of pulse wave velocity: site matters. J Hypertension. (2007) 25:383–9.

Google Scholar

16. McEniery CM, Yasmin Hall IR, Qasem A, Wilkinson IB, Cockcroft JR. Normal vascular aging: differential effects on wave reflection and aortic pulse wave velocity: the Anglo-Cardiff Collaborative Trial (ACCT). J Am Coll Cardiol. (2005) 46:1753–60. doi: 10.1016/j.jacc.2005.07.037

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Wilkinson IB, McEniery CM, Schillaci G, Boutouyrie P, Donald A, Chowienczyk PJ, et al. ARTERY Society guidelines for validation of non-invasive haemodynamic measurement devices: part 1, arterial pulse wave velocity. Artery Res. (2010) 4:34–40.

Google Scholar

18. Weber T, Ammer M, Rammer M, Adji A, O’Rourke MF, Wassertheurer S, et al. Noninvasive determination of carotid-femoral pulse wave velocity depends critically on assessment of travel distance: a comparison with invasive measurement. J Hypertens. (2009) 27:1624–30. doi: 10.1097/HJH.0b013e32832cb04e

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Horvath IG, Nemeth A, Lenkey Z, Alessandri N, Tufano F, Kis P, et al. Invasive validation of a new oscillometric device (Arteriograph) for measuring augmentation index, central blood pressure and aortic pulse wave velocity. J Hypertens. (2010) 28:2068–75. doi: 10.1097/HJH.0b013e32833c8a1a

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Davies JM, Bailey MA, Griffin KJ, Scott DJ. Pulse wave velocity and the non-invasive methods used to assess it: complior, sphygmocor, arteriograph and vicorder. Vascular. (2012) 20:342–9. doi: 10.1258/vasc.2011.ra0054

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Gunjaca G, Jeroncic A, Budimir D, Mudnic I, Kolcic I, Polasek O, et al. A complex pattern of agreement between oscillometric and tonometric measurement of arterial stiffness in a population-based sample. J Hypertens. (2012) 30:1444–52. doi: 10.1097/HJH.0b013e3283546532

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Segers P, Kips J, Trachet B, Swillens A, Vermeersch S, Mahieu D, et al. Limitations and pitfalls of non-invasive measurement of arterial pressure wave reflections and pulse wave velocity. Artery Res. (2009) 3:79–88.

Google Scholar

23. Visseren FLJ, Mach F, Smulders YM, Carballo D, Koskinas KC, Back M, et al. 2021 ESC Guidelines on cardiovascular disease prevention in clinical practice. Eur Heart J. (2021) 42:3227–337.

Google Scholar

24. Townsend RR, Wilkinson IB, Schiffrin EL, Avolio AP, Chirinos JA, Cockcroft JR, et al. Recommendations for improving and standardizing vascular research on arterial stiffness: a scientific statement from the American heart association. Hypertension. (2015) 66:698–722.

Google Scholar

25. Di Pilla M, Bruno RM, Stea F, Massetti L, Taddei S, Ghiadoni L, et al. Impact of seasonality and air pollutants on carotid-femoral pulse wave velocity and wave reflection in hypertensive patients. PLoS One. (2017) 12:e0172550. doi: 10.1371/journal.pone.0172550

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Kita T, Kitamura K. Seasonal variation of novel arterial stiffness indexes in Japanese hypertensive patients. Clin Exp Hypertens. (2019) 41:670–4. doi: 10.1080/10641963.2018.1539092

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Lantelme P, Mestre C, Lievre M, Gressard A, Milon H. Heart rate: an important confounder of pulse wave velocity assessment. Hypertension. (2002) 39:1083–7.

Google Scholar

28. Elliot CA, Hamlin MJ, Lizamore CA. Inter-operator reliability for measuring pulse wave velocity and augmentation index. Front Cardiovasc Med. (2020) 7:72. doi: 10.3389/fcvm.2020.00072

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Drager LF, Diegues-Silva L, Diniz PM, Lorenzi-Filho G, Krieger EM, Bortolotto LA. Lack of circadian variation of pulse wave velocity measurements in healthy volunteers. J Clin Hypertens. (2011) 13:19–22. doi: 10.1111/j.1751-7176.2010.00381.x

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Giannattasio C, Failla M, Mangoni AA, Scandola L, Fraschini N, Mancia G. Evaluation of arterial compliance in humans. Clin Exp Hypertens. (1996) 18:347–62.

Google Scholar

31. Kim EJ, Park CG, Park JS, Suh SY, Choi CU, Kim JW, et al. Relationship between blood pressure parameters and pulse wave velocity in normotensive and hypertensive subjects: invasive study. J Hum Hypertens. (2007) 21:141–8. doi: 10.1038/sj.jhh.1002120

PubMed Abstract | CrossRef Full Text | Google Scholar

32. O’Rourke MF, Hayward CS. Arterial stiffness, gender and heart rate. J Hypertens. (2003) 21:487–90.

Google Scholar

33. Osman MW, Leone F, Nath M, Khalil A, Webb DR, Robinson TG, et al. Diurnal variation and repeatability of arterial stiffness and cardiac output measurements in the third trimester of uncomplicated pregnancy. J Hypertens. (2017) 35:2436–42. doi: 10.1097/HJH.0000000000001482

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Stewart AD, Millasseau SC, Kearney MT, Ritter JM, Chowienczyk PJ. Effects of inhibition of basal nitric oxide synthesis on carotid-femoral pulse wave velocity and augmentation index in humans. Hypertension. (2003) 42:915–8. doi: 10.1161/01.HYP.0000092882.65699.19

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Tan I, Spronck B, Kiat H, Barin E, Reesink KD, Delhaas T, et al. Heart rate dependency of large artery stiffness. Hypertension. (2016) 68:236–42.

Google Scholar

36. Centres for Disease Control and Prevention. Healthy Weight, Nutrition, and Physical Activity. (2021). Available online at: https://www.cdc.gov/healthyweight/assessing/bmi/adult_bmi/index.html (accessed April 12, 2022).

Google Scholar

37. Bossuyt J, Van De Velde S, Azermai M, Vermeersch SJ, De Backer TL, Devos DG, et al. Noninvasive assessment of carotid-femoral pulse wave velocity: the influence of body side and body contours. J Hypertens. (2013) 31:946–51. doi: 10.1097/HJH.0b013e328360275d

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Levi-Marpillat N, Desamericq G, Akakpo S, Affes-Ayadi H, Tropeano AI, Millasseau S, et al. Crucial importance of using a sliding calliper to measure distance for carotid-femoral pulse wave velocity assessment. J Hypertens. (2013) 31:940–5. doi: 10.1097/HJH.0b013e32835e2a2f

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Mass CJM, Hox JJ. Sufficient sample sizes for multilevel modeling. Methodology. (2005) 1:86–92.

Google Scholar

40. Mass CJM, Hox JJ. The influence of violations of assumptions on multilevel parameter estimates and their standard errors. Comput Stat Data Anal. (2004) 46:427–40.

Google Scholar

41. Park J, Yu HT. Recommendations on the sample sizes for multilevel latent class models. Educ Psychol Meas. (2017) 78:737–61.

Google Scholar

42. Field AP, Wilcox RR. Robust statistical methods: a primer for clinical psychology and experimental psychopathology researchers. Behav Res Ther. (2017) 98:19–38. doi: 10.1016/j.brat.2017.05.013

PubMed Abstract | CrossRef Full Text | Google Scholar

43. White H. A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica. (1980) 48:817–30.

Google Scholar

44. Bland JM. How Should I Calculate a within-Subject Coefficient of Variation?. (2006). Available online at: https://www-users.york.ac.uk/~mb55/meas/cv.htm (accessed March 6, 2022).

Google Scholar

45. Loughman J. The Statistical Interpretation of the Coefficient of Repeatability. Dublin: Technological University Dublin (2010).

Google Scholar

46. Deming SN, Michotte Y, Massart DL, Kaufman L, Vandeginste BGM. Multivariate calibration. Data handling in science and technology. Elsevier. (1998) 20:349–81.

Google Scholar

47. Wilkinson IB, Fuchs SA, Jansen IM, Spratt JC, Murray GD, Cockcroft JR, et al. Reproducibility of pulse wave velocity and augmentation index measured by pulse wave analysis. J Hypertens. (1998) 16(12 Pt 2):2079–84.

Google Scholar

48. Grillo A, Parati G, Rovina M, Moretti F, Salvi L, Gao L, et al. Short-term repeatability of noninvasive aortic pulse wave velocity assessment: comparison between methods and devices. Am J Hypertens. (2017) 31:80–8. doi: 10.1093/ajh/hpx140

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Garcia-Ortiz L, Recio-Rodriguez JI, Agudo-Conde C, Maderuelo-Fernandez JA, Patino-Alonso MC, de Cabo-Laso A, et al. Noninvasive validation of central and peripheral augmentation index estimated by a novel wrist-worn tonometer. J Hypertens. (2018) 36:2204–14. doi: 10.1097/HJH.0000000000001806

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Matsui Y, Kario K, Ishikawa J, Eguchi K, Hoshide S, Shimada K. Reproducibility of arterial stiffness indices (pulse wave velocity and augmentation index) simultaneously assessed by automated pulse wave analysis and their associated risk factors in essential hypertensive patients. Hypertens Res. (2004) 27:851–7. doi: 10.1291/hypres.27.851

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Meyer ML, Tanaka H, Palta P, Patel MD, Camplain R, Couper D, et al. Repeatability of central and peripheral pulse wave velocity measures: the atherosclerosis risk in communities (ARIC) study. Am J Hypertens. (2016) 29:470–5. doi: 10.1093/ajh/hpv127

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Shahin Y, Barakat H, Barnes R, Chetter I. The Vicorder device compared with SphygmoCor in the assessment of carotid-femoral pulse wave velocity in patients with peripheral arterial disease. Hypertens Res. (2013) 36:208–12. doi: 10.1038/hr.2012.144

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Kubalski P, Hering D. Repeatability and reproducibility of pulse wave velocity in relation to hemodynamics and sodium excretion in stable patients with hypertension. J Hypertens. (2020) 38:1531–40. doi: 10.1097/HJH.0000000000002416

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Li Y, Cordes M, Recio-Rodriguez JI, Garcia-Ortiz L, Hanssen H, Schmidt-Trucksass A. Diurnal variation of arterial stiffness in healthy individuals of different ages and patients with heart disease. Scan J Clin Lab Investig. (2014) 74:155–62. doi: 10.3109/00365513.2013.864787

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Ring M, Eriksson MJ, Zierath JR, Caidahl K. Arterial stiffness estimation in healthy subjects: a validation of oscillometric (Arteriograph) and tonometric (SphygmoCor) techniques. Hypertens Res. (2014) 37:999–1007. doi: 10.1038/hr.2014.115

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Cecelja M, Chowienczyk P. Dissociation of aortic pulse wave velocity with risk factors for cardiovascular disease other than hypertension: a systematic review. Hypertension. (2009) 54:1328–36. doi: 10.1161/HYPERTENSIONAHA.109.137653

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Reference Values for Arterial Stiffness’ Collaboration. Determinants of pulse wave velocity in healthy people and in the presence of cardiovascular risk factors: ‘establishing normal and reference values’. Eur Heart J. (2010) 31:2338–50. doi: 10.1093/eurheartj/ehq165

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Seidlerova J, Filipovsky J, Mayer O, Wohlfahrt P, Cifkova R. Positive effects of antihypertensive treatment on aortic stiffness in the general population. Hypertens Res. (2014) 37:64–8.

Google Scholar

59. Gujral UP, Mehta A, Sher S, Uphoff I, Kumar S, Hayek SS, et al. Ethnic differences in subclinical vascular function in South Asians, Whites, and African Americans in the United States. Int J Cardiol Heart Vasculat. (2020) 30:100598. doi: 10.1016/j.ijcha.2020.100598

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Yasmin, McEniery CM, Wallace S, Mackenzie IS, Cockcroft JR, Wilkinson IB. C-reactive protein is associated with arterial stiffness in apparently healthy individuals. Arterioscl Thromb Vasc Biol. (2004) 24:969–74.

Google Scholar

61. Jatoi NA, Mahmud A, Bennett K, Feely J. Assessment of arterial stiffness in hypertension: comparison of oscillometric (Arteriograph), piezoelectronic (Complior) and tonometric (SphygmoCor) techniques. J Hypertens. (2009) 27:2186–91.

Google Scholar

62. Mellin J, Le Prevost M, Kenny J, Sturgeon K, Thompson LC, Foster C, et al. Arterial stiffness in a cohort of young people living with perinatal HIV and HIV negative young people in England. Front Cardiovasc Med. (2022) 9:821568. doi: 10.3389/fcvm.2022.821568

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Cabrera SE, Mindell JS, Toledo M, Alvo M, Ferro CJ. Associations of blood pressure with geographical latitude, solar radiation, and ambient temperature: results from the chilean health survey, 2009-2010. Am J Epidemiol. (2016) 183:1071–3. doi: 10.1093/aje/kww037

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Modesti PA, Bamoshmoosh M, Rapi S, Massetti L, Al-Hidabi D, Al Goshae H. Epidemiology of hypertension in Yemen: effects of urbanization and geographical area. Hypertens Res. (2013) 36:711–7. doi: 10.1038/hr.2013.14

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Modesti PA, Morabito M, Massetti L, Rapi S, Orlandini S, Mancia G, et al. Seasonal blood pressure changes: an independent relationship with temperature and daylight hours. Hypertension. (2013) 61:908–14. doi: 10.1161/HYPERTENSIONAHA.111.00315

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Modesti PA, Parati G. Seasonal blood pressure changes: which ambient temperature should we consider? J Hypertens. (2014) 32:1577–9.

Google Scholar

67. Lewington S, Li L, Sherliker P, Guo Y, Millwood I, Bian Z, et al. Seasonal variation in blood pressure and its relationship with outdoor temperature in 10 diverse regions of China: the China Kadoorie Biobank. J Hypertens. (2012) 30:1383–91. doi: 10.1097/HJH.0b013e32835465b5

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Edwards DG, Gauthier AL, Hayman MA, Lang JT, Kenefick RW. Acute effects of cold exposure on central aortic wave reflection. J Appl Physiol. (2006) 100:1210–4.

Google Scholar

69. Salvi P, Palombo C, Salvi GM, Labat C, Parati G, Benetos A. Left ventricular ejection time, not heart rate, is an independent correlate of aortic pulse wave velocity. J Appl Physiol. (2013) 115:1610–7.

Google Scholar

70. Albaladejo P, Copie X, Boutouyrie P, Laloux B, Declere AD, Smulyan H, et al. Heart rate, arterial stiffness, and wave reflections in paced patients. Hypertension. (2001) 38:949–52.

Google Scholar

71. Haesler E, Lyon X, Pruvot E, Kappenberger L, Hayoz D. Confounding effects of heart rate on pulse wave velocity in paced patients with a low degree of atherosclerosis. J Hypertens. (2004) 22:1317–22.

Google Scholar

72. de Simone G, Schillaci G, Chinali M, Angeli F, Reboldi GP, Verdecchia P. Estimate of white-coat effect and arterial stiffness. J Hypertens. (2007) 25:827–31.

Google Scholar

73. Barochiner J, Aparicio LS, Alfie J, Morales MS, Cuffaro PE, Rada MA, et al. Arterial stiffness in treated hypertensive patients with white-coat hypertension. J Clin Hypertens. (2017) 19:6–10.

Google Scholar

74. Franklin SS, Thijs L, Hansen TW, O’Brien E, Staessen JA. White-coat hypertension: new insights from recent studies. Hypertension. (2013) 62:982–7.

Google Scholar

75. Kollias GE, Stamatelopoulos KS, Papaioannou TG, Zakopoulos NA, Alevizaki M, Alexopoulos GP, et al. Diurnal variation of endothelial function and arterial stiffness in hypertension. J Hum Hypertens. (2009) 23:597–604.

Google Scholar

76. Strozecki P, Adamowicz A, Wlodarczyk Z, Manitius J. Factors associated with increased arterial stiffness in renal transplant recipients. Med Sci Monit. (2010) 16:CR301–6.

Google Scholar

77. Muxfeldt ES, Fiszman R, Castelpoggi CH, Salles GF. Ambulatory arterial stiffness index or pulse pressure: which correlates better with arterial stiffness in resistant hypertension? Hypertens Res. (2008) 31:607–13.

Google Scholar

78. Giallauria F, Ling SM, Schreiber C, Maggio M, Shetty V, Muller D, et al. Arterial stiffness and bone demineralization: the Baltimore longitudinal study of aging. Am J Hypertens. (2011) 24:970–5. doi: 10.1038/ajh.2011.80

PubMed Abstract | CrossRef Full Text | Google Scholar

79. Kim JY, Park JB, Kim DS, Kim KS, Jeong JW, Park JC, et al. Gender difference in arterial stiffness in a multicenter cross-sectional study: the Korean Arterial Aging Study (KAAS). Pulse. (2014) 2:11–7. doi: 10.1159/000365267

PubMed Abstract | CrossRef Full Text | Google Scholar

80. Vermeersch SJ, Rietzschel ER, De Buyzere ML, De Bacquer D, De Backer G, Van Bortel LM, et al. Age and gender related patterns in carotid-femoral PWV and carotid and femoral stiffness in a large healthy, middle-aged population. J Hypertens. (2008) 26:1411–9. doi: 10.1097/HJH.0b013e3282ffac00

PubMed Abstract | CrossRef Full Text | Google Scholar

81. Booth AD, Wallace S, McEniery CM, Yasmin, Brown J, Jayne DR, et al. Inflammation and arterial stiffness in systemic vasculitis: a model of vascular inflammation. Arthritis Rheum. (2004) 50:581–8. doi: 10.1002/art.20002

PubMed Abstract | CrossRef Full Text | Google Scholar

82. Piko N, Bevc S, Hojs R, Naji FH, Ekart R. The association between pulse wave analysis, carotid-femoral pulse wave velocity and peripheral arterial disease in patients with ischemic heart disease. BMC Cardiovasc Disord. (2021) 21:33. doi: 10.1186/s12872-021-01859-0

PubMed Abstract | CrossRef Full Text | Google Scholar

83. Mitchell GF, Parise H, Benjamin EJ, Larson MG, Keyes MJ, Vita JA, et al. Changes in arterial stiffness and wave reflection with advancing age in healthy men and women: the Framingham Heart Study. Hypertension. (2004) 43:1239–45. doi: 10.1161/01.HYP.0000128420.01881.aa

PubMed Abstract | CrossRef Full Text | Google Scholar

84. Reusz GS, Cseprekal O, Temmar M, Kis E, Cherif AB, Thaleb A, et al. Reference values of pulse wave velocity in healthy children and teenagers. Hypertension. (2010) 56:217–24. doi: 10.1161/HYPERTENSIONAHA.110.152686

PubMed Abstract | CrossRef Full Text | Google Scholar

85. Nurnberger J, Michalski R, Turk TR, Opazo Saez A, Witzke O, Kribben A. Can arterial stiffness parameters be measured in the sitting position? Hypertens Res. (2011) 34:202–8.

Google Scholar

86. Murphy KR, Myors B, Wolach AH. Statistical Power Analysis : a Simple and General Model for Traditional and Modern Hypothesis Tests. 3rd ed. New York, NY: Routledge (2009). 212 p.

Google Scholar

Keywords: carotid-femoral pulse wave velocity, pulse wave velocity, within subject variation, predictors, meteorological conditions, experimental conditions, measurement error, measurement difficulty

Citation: Podrug M, Šunjić B, Bekavac A, Koren P, Đogaš V, Mudnić I, Boban M and Jerončić A (2023) The effects of experimental, meteorological, and physiological factors on short-term repeated pulse wave velocity measurements, and measurement difficulties: A randomized crossover study with two devices. Front. Cardiovasc. Med. 9:993971. doi: 10.3389/fcvm.2022.993971

Received: 14 July 2022; Accepted: 21 December 2022;
Published: 11 January 2023.

Edited by:

Francesco Fantin, University of Verona, Italy

Reviewed by:

János Nemcsik, Semmelweis University, Hungary
Francesco Faita, Institute of Clinical Physiology, Italy

Copyright © 2023 Podrug, Šunjić, Bekavac, Koren, Đogaš, Mudnić, Boban and Jerončić. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Ana Jerončić, www.frontiersin.org ajeronci@mefst.hr

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.