The participation of clinical pharmacists in the treatment of patients with central nervous system infection can improve the effectiveness and appropriateness of anti-infective treatments: a retrospective cohort study

Background: Central nervous system infection (CNSI) treatment in hospital neurosurgery emphasizes the importance of optimizing antimicrobial therapy. Timely and appropriate empiric antibiotic treatment is critical for managing patients with bacterial meningitis.

Objectives: To evaluate the activities of clinical pharmacists in the anti-infective treatment of patients with CNSI in neurosurgery.

Method: A single-center retrospective cohort study was carried out from January 2021 to March 2023 at a tertiary teaching hospital in China. The study sample included a group that received pharmacy services and a group that did not. In the pharmacy services group, the anti-infective treatment plan was led and developed by pharmacists. Pharmaceutical care, including medication therapy and all CNSI treatment regimens, was administered in daily unit rounds by pharmacists. Baseline demographics, treatment outcomes, and rational use of antibiotics were compared between the two groups, and the impact of a antimicrobial stewardship (AMS) program was evaluated.

Results: Of the 306 patients assessed according to the inclusion and exclusion criteria, 151 patients were included, and 155 patients were excluded due to abnormal data and missing information on antibiotic costs or antimicrobial use. Eventually, 73 were included in the pharmacy services group and 78 in the group without pharmacist participation. The antibiotic use density (AUD) of the pharmacy services group decreased from 167.68 to 127.63 compared to the group without pharmacist participation. After the pharmacist services, the AUD for linezolid decreased from 9.15% to 5.23% and that for miscellaneous agents decreased from 17.91% to 6.72%. The pharmacy services group had better improvement (p < 0.05) and a significantly higher score for the rational use of antibiotics (p < 0.05) than the group without pharmacist participation.

Conclusion: The clinical pharmacist services evaluation results demonstrated an essential role of clinical pharmacist-led AMS programs in the effective and appropriate use of anti-infective treatments in neurosurgery with patients with CNSI.

1 Introduction

Central nervous system infection (CNSI) including meningitis, ventriculitis, and brain abscess, are mainly caused by postneurosurgical infection, foreign body implantation, and traumatic brain injury and are characterized by high morbidity, high mortality, and poor prognosis (Archibald and Quisling, 2013; Wang, 2021). CNSI continue to be a significant cause of mortality and morbidity worldwide. The incidence of postneurosurgical CNSI ranges from 0.3% to 25%, the incidence of CNSI caused by craniocerebral trauma is 1.4%, and the mortality rate of postneurosurgical CNSI ranges from 3% to 33% (Archibald and Quisling, 2013; Tan et al., 2015; Hernández Ortiz et al., 2018; Pan et al., 2018). According to the 2017 Infectious Diseases Society of America’s Clinical Practice Guidelines, the most common bacterial pathogens among bacterial infection in CNSI are coagulase-negative Staphylococcus, Streptococcus pneumoniae, Staphylococcus aureus, and Neisseria meningitides (Tunkel et al., 2017). The time-consuming nature and low positive rate of cerebrospinal fluid (CSF) culture, the impact of the blood‒brain barrier, and the emergence of drug-resistant bacteria increase the difficulty of antibiotic selection and the treatment of CNSI(Dorsett and Liang, 2016; Tunkel et al., 2017). Early empiric antibiotic treatment is critical for managing patients with bacterial meningitis. (Tan et al., 2015). One retrospective study showed that initial antibiotic combination therapy improved the in-hospital mortality rate among neurocritical care unit patients with nosocomial meningitis (Li et al., 2016). Timely and appropriate anti-infective treatment regimens for CNSI are essential to increase the cure rate and improve the prognosis of CNSI to reduce patient burden (Sonneville et al., 2017; Younger and Coyle, 2019; Shun-xiao et al., 2020; Li et al., 2022). Consequently, pharmacists may make some of their most important clinical contributions in treating patients with CNS infection.

In recent years, clinical pharmacists have received increasing attention worldwide, especially during the COVID-19 pandemic (Gu et al., 2023). Studies have demonstrated the beneficial effects of the participation of clinical pharmacists in treating patients with chronic illnesses such as diabetes, atrial fibrillation, and cardiovascular disorders (Skelton and Binaso, 2012; Falamić et al., 2018; Warden et al., 2019). The Infectious Diseases Society of America guidelines highlight the importance of clinical pharmacists on the antimicrobial stewardship teams (Dellit et al., 2007). The Chinese Hospital Association and the American College of Clinical Pharmacy have established standards for clinical pharmacists’ level of clinical pharmacy services and the specialty training required for these positions (Dellit et al., 2007; China Hospital Association Clinical Pharmacist Training Expert Steering Committee, 2008; Saseen et al., 2017). Antimicrobial stewardship (AMS) programs were created to improve infection regimens and minimize infection-related morbidity and death (Barlam et al., 2016; Álvarez-Lerma et al., 2018). Evidence shows that pharmacists significantly impact multiple clinical and economic outcomes. For example, pharmacists in the discharge process benefit neurosurgical patients by reducing the number of discrepancies and providing an additional layer of safety to reduce medication errors and prevent adverse events (Greenwood et al., 2023). Another retrospective cohort study found that the presence of clinical pharmacists on a neurosurgery team considerably reduced hospital stays, readmission rates, and pharmacy expenses. Their involvement in a neurosurgical team should be considered a standard of care (Weant et al., 2009). Clinical pharmacists join the neurosurgery team to identify prescribing errors, monitor or modify doses, identify adverse effects associated with multiple drug combinations, optimize antibiotic use, and provide clinical outcomes to reduce the burden of patient care (Bourne and Dorward, 2011; Gallagher et al., 2014). Therefore, in this study, we aimed to investigate the benefits of clinical pharmacy services for patients with CNSI. We aimed to assess the effect of a clinical pharmacists services on the effectiveness and appropriateness of anti-infection treatments in CNSI patients.

2 Methods

2.1 Study design

This single-center retrospective cohort study was conducted at the First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital (a 4000-bed tertiary care hospital) in Shandong Province, China. This study was conducted with two neurosurgical group and retrospective collecting patient information with CNSI between 2021.1.1 and 2023.3.1. The patients include two groups: the pharmacy services group, which received a routine pharmacist services during hospitalization, and group without pharmacist participation.

The study was approved by The Ethics Committee of the First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital (approval number: 2023S357). It was conducted following the Helsinki Declaration guidelines, and informed consent was not required due to retrospective and diagnostic data collection.

2.2 Study participants

2.2.1 Inclusion criteria

This study included patients with CNSI diagnosed in the neurosurgery department of the hospital. The diagnosis of the infection required patients to meet two or more of the following criteria (Horan et al., 2008; Archibald and Quisling, 2013): 1) isolation of pathogens from CSF; 2) at least one of the following signs with no other recognized cause: fever (>38 °C), headache, stiff neck, meningeal signs, cranial nerve signs, changing level of consciousness, or confusion; and 3) the following abnormalities on the CSF test: corrected (Greenberg et al., 2008) white blood cell count >5 × 10⁶ cells/L, protein concentration >45 mg/L, and/or CSF glucose <50 mg/dL.

2.2.2 Exclusion criteria

Patients who met any of the following criteria were excluded (Gu et al., 2023): 1) patients were not using antimicrobials on admission, or antimicrobial information was missing; 2) laboratory tests showed extremely abnormal values, such as alanine aminotransferase or aspartate aminotransferase >1,000; 3) the number of days of hospitalization was <1 day or >30 days; or 4) patients had incomplete medical history information.

2.3 Pharmaceutical service process

2.3.1 Pharmacy services group

The clinical pharmacist, who had completed specialized training and had over 10 years of hospital pharmacy experience in the neurology department, was assigned to the one neurosurgical group to ensure the consistency and quality of the treatments. In the pharmacy services group, the pharmacist implemented clinical pharmacy services by carrying out the following steps. 1) The pharmacist spent at least 20 h per week with neurosurgery physicians participating in daily unit rounds. The pharmacist focused on medication therapy management, including medical order review, patient monitoring, dynamic treatment regimens (DTRs), etc. 2) The pharmacist was involved in the development of all CNSI treatment regimens, including therapeutic indications, drug selection, dose, route of administration, and period of treatment, etc. The pharmacist adjusted the dosage based on the patient’s liver and kidney function. 3) The AMS program was implemented if the pharmacist had different opinions after revisions. 4) The adjustment plan was presented to the senior physician and an expert in neurosurgery. 5) Pharmaceutical monitoring and the adjustment treatment plans were implemented based on the treatment outcomes and safety.

2.3.2 Group without pharmacist participation

In the other neurosurgical group, the treatment involved the doctor’s routine diagnosis and treatment, and pharmacists did not participate in the therapeutic schedule.

2.4 Outcomes and measurement

The primary outcome was clinical effectiveness, which was categorized as follows (Tunkel et al., 2004; Archibald and Quisling, 2013): 1) Cured: resolution of symptoms, negative CSF cultures, and a regular CSF examination (WBC count: <5*10⁶ cells/L, protein concentration: <45 mg/L, and/or CSF glucose: >50 mg/dL); 2) Improved: negative CSF cultures and partial resolution of clinical signs and symptoms of infection, or CSF examination improved but did not return to normal. 3) Invalid: Positive or negative CSF cultures and symptoms of infection and worsening of CSF indices compared to baseline. The secondary outcome was the appropriateness of medication, which was evaluated based on an antibiotic appropriateness assessment score. We used the 5R principles of rational drug use as our evaluation metric and constructed an analytic hierarchy process (AHP) evaluation system (Saaty, 1990; Mobinizadeh et al., 2016; Li et al., 2017). Two clinical pharmacy experts skilled in anti-infective treatment reviewed the medical records of the two groups of inpatients. They used a scoring system to assess the appropriateness of the use of antibiotics to treat CNSI. If the anti-infective treatment specialist identified inappropriate antibiotic use, the item was scored and multiplied by the appropriate weight (Table 1.) determined by the AHP to produce a final score.

TABLE 1

TABLE 1. The indicators and weight of each indicator.

Other outcomes included antibiotic consumption, medical costs, and length of hospital stay (LOS). The WHO confirmed the defined daily dose (DDD) and antibiotic use density (AUD) for antibiotics (WHO, 2022). In addition, we collected the AUD (%) and AUD decrease (%) as indicators to assess the impact of pharmacy services on antibiotic use. The cost of antibiotics, the total cost of drugs, and the total cost of hospitalization were collected. The cost of antibiotics refers to the price of antibiotics administered to the patient to treat the CNSI during hospitalization. Medical service efficiency was measured by the LOS, which was calculated by subtracting the admission date from the discharge date. In this study, a cost-effectiveness analysis (CEA) was used to assess the relationship between the cost and effectiveness of the two groups. The long-term clinical and economic outcomes of pharmacy services were calculated using the incremental cost-effectiveness ratio (ICER). The ICER calculated the difference in hospitalization costs between the pharmacy services group and the group without pharmacist participation, divided by the difference in treatment improved rate between the two groups (Tang et al., 2019). In terms of the cost-effectiveness threshold, WHO defines a health intervention as highly cost-effective if it costs less than the gross domestic product (GDP) per capita of a given country, and as cost-effective if it costs less than three times the GDP per capita. The per capita GDP stratified for China was $12,741.11 in 2022 (China National Bureau of Statistics, 2023). For the cost of medical, the costs used in this study were prior to Medicare reimbursement. The State Administration of Foreign Exchange in China monitored the exchange rate between the RMB and the US dollar. On 2022, the average rate was US $100 = RBM 672.61 Yuan.

2.5 Data collection

The following were obtained from the Hospital Information System (HIS) and laboratory Information Management System (LIS) for each inpatient. 1) General demographic attributes, including age and sex, weight, LOS, surgery and placement of invasive devices, were collected. 2) Pathogens in the CSF and the antimicrobial susceptibility results were assessed. 3) Laboratory test results were obtained, including glucose level, protein level, chlorine level, leukocyte count, and erythrocyte count in the CSF; white blood cell count, procalcitonin (PCT) value, and the levels of liver function indicators, including alanine aminotransferase (ALT), aspartate aminotransferase (AST), and total bilirubin (TBIL); and creatinine levels. The creatinine clearance rate (CrCL) was estimated by the Cockcroft-Gault method. We collected laboratory test results before and twice after the anti-infective treatment. 4) Antibiotic use, including the medication name, dosage unit, package, defined daily dose (DDD), administration route, and the time of issuing and stopping medical orders, were assessed. 5) Finally, antibiotic treatment costs were determined.

2.6. Statistical analysis

Descriptive statistics were used to characterize the study group. The mean and standard deviation, median (interquartile range, IQR), and number (percentage) were used to depict normally distributed, nonnormally distributed continuous, and categorical data, respectively. Normally distributed quantitative variables were analyzed for differences between groups using Student’s t-test, and nonnormally distributed data were analyzed using the Mann‒Whitney rank sum test. The qualitative variables were compared using the chi-square test or Fisher’s exact test. p < 0.05 was considered statistically significant. All comparisons were based on two-tailed tests. SPSS Statistics v.26.0 (IBM Corp., NY, USA) was used for all statistical analyses.

3 Results

3.1 Demographic characteristics

A total of 306 patients with CNSI were admitted to the neurosurgical department during the study period (2021 and 2023). According to the inclusion and exclusion criteria, 151 patients were included, and 155 patients were eliminated because of abnormal data and missing information on antibiotic costs or antimicrobial usage (Figure 1.). The initial analysis included 78 patients in the group without pharmacist participation and 73 patients in the pharmacy services group. Baseline characteristics for the group without pharmacist participation and pharmacy services group are shown in Table 2. Sex, age, weight, PCT, CrCL, ALT, and creatinine were selected as baseline indicators, and the above indicators did not differ between the two groups (p > 0.05).

FIGURE 1

FIGURE 1. Diagram of the patient assessment and inclusion process.

TABLE 2

TABLE 2. Baseline characteristics of study patients.

3.2 Quantitative descriptions of pharmacist recommendations

A total of 420 pharmacist recommendations were identified, with 399 (95.00%) reaching an agreement between the clinical pharmacist and the neurosurgery physicians. In this study, neurosurgical pharmacists achieve the AMS program primarily through the following core services, anti-infective drug selection (146/420, 34.76%) with an acceptance rate of 94.52%, anti-infective dose recommendations (103/420, 24.52%) with an acceptance rate of 95.15%, anti-infective duration recommendations (73/420, 17.38%) with an acceptance rate of 95.89%, anti-infective route recommendations (18/420, 4.29%) with an acceptance rate of 95.00%.

3.3 Clinical effectiveness

As shown in Table 3, the treatment outcome showed that 6 (8.2%) patients in the pharmacy services group were cured, while 49 (67.1%) were improved. Moreover, among the 78 patients in the group without pharmacist participation, 3 (3.8%) and 39 (50%) were determined to be cured and improved, respectively, and no significant difference was detected in the cure rates between the two groups (p > 0.05). However, the pharmacy services group had a better improvement rate than the group without pharmacist participation (p < 0.05). In addition, the LOS values were not significantly different between the two groups (p > 0.05).

TABLE 3

TABLE 3. Outcomes of patients with CNSIs in the Group without pharmacist participation and pharmacy-services groups.

3.4 Appropriateness of medication

The pharmacy services group had a significantly higher score for the rational use of antibiotics than the group without pharmacist participation (p < 0.05), which is shown in Table 3. Analysis of combination therapy showed that no significant differences were found between the two groups for single, double or triple combinations. A study of antibiotic conversion rates showed that the switch rate of the antibiotic regimen in the pharmacy services group was much lower than that in the group without pharmacist participation (p < 0.05).

3.5 Other outcomes

We were interested in the impact of pharmacist services on antibiotic use in neurosurgical patients. The pharmacist services reduced the AUD of all antibiotics used in neurosurgery from 167.68 to 127.63. According to Table 4, the AUD proportions declined for linezolid (9.15% vs. 3.92%), miscellaneous agents (17.91% vs. 6.72%), and polymyxin B (2.82% vs. 1.06%). The AUD proportions increased by 5.37%, 3.82%, and 8.99% for vancomycin (from 21.91% to 27.28%), meropenem (from 41.02% to 44.84%), and ceftriaxone (from 7.19% to 16.17%), respectively. The pharmacist services did not significantly impact antibiotic co-administration but reduced the rate of antibiotic switches. In addition, there were no significant differences between the two groups in other indicators, such as antibiotic costs (p = 0.647) or DDDs (p = 0.213). Although the drug and hospitalization costs in the pharmacy-services group increased (p < 0.05), the pharmacy-services group had an ICER less than the Chinese threshold ($409.99 vs. $12,741.11).

TABLE 4

TABLE 4. Effect of pharmacist services on the type and amount of antibiotics used.

4 Discussion

4.1 Statement of key findings

The National Health Commission of China issued the strictest regulation on antimicrobial drugs in 2011, as the number of antibiotic-resistant bacteria has become a severe problem in China (Hu et al., 2016). The Antimicrobial Stewardship (AMS) Program was created to solve these issues. The AMS was designed to optimize the treatment of infection, reduce infection-related morbidity and mortality, limit the emergence of multidrug-resistant organisms (MDROs), and reduce unnecessary antimicrobial use (Álvarez-Lerma et al., 2018). The AMS indicates that pharmacists have a responsibility to play a prominent role in antimicrobial stewardship, infection prevention and control programs in healthcare systems. Core elements of effective antimicrobial stewardship programs typically include hospital leadership commitment, the appointment of a pharmacist to lead the implementation of antimicrobial stewardship interventions, monitoring of antimicrobial prescribing, regular reporting of information on antimicrobial use and resistance to prescribers, and education on rational use of medicines (CDC, 2019). Pharmacists participate in antimicrobial stewardship, infection prevention and control efforts through clinical efforts focused on the appropriate use of antimicrobial agents and through membership in relevant multidisciplinary workgroups and committees within the healthcare system (Saseen et al., 2017; Lai et al., 2022). Currently, pharmacists in China mainly participate in the daily ward rounds in neurosurgery units and review medication regimens (Zhang et al., 2020b; Zhang et al., 2021; Wang et al., 2022; Gu et al., 2023). The involvement of pharmacists in patient medical treatment and monitoring is the ideal approach in neurosurgery units because of the complexity of CNSI, the severity of these diseases, and the difficulty of drug selection. In this study, a pharmacist worked in a neurosurgery unit reviewing prescriptions for patients with CNSI and discussing treatment issues with the surgeon as needed. The pharmacist engaged in medical treatment discussions and exchange of ideas. Ultimately, pharmacists use treatment regimens optimized for infected patients according to professional guidelines or treatment criteria.

In this study, we assessed the effects of the participation of clinical pharmacists in the treatment of patients with CNSI on the effectiveness of antibiotic prescriptions. The results of our study showed that the pharmacy services group had a significantly higher rate of treatment improvement and efficiency than the group without pharmacist participation (p < 0.05). A meta-analysis on cardiovascular disease showed a similar finding: pharmacist services provides a wide range of benefits in cardiovascular disease management, from controlling risk factors to improving medication adherence and, in some settings, reducing morbidity and mortality (Rattanavipanon et al., 2022). No significant effect of the pharmacist services on the cure rate was observed in this study, partly because CNSI have a long course of treatment, making it difficult to achieve the desired treatment outcome during hospitalization, and partly because of our strict cure criteria. The criteria for cure in this study were based on diagnostic criteria, and there is no clear literature support for the criteria for the cure of CNSI.

The AHP approach can be used for decision analysis and calculation in the healthcare system (Khan et al., 2022; Kim et al., 2022). With the help of the AHP, pharmacists can objectively and comprehensively evaluate medicine, which is convenient for identifying problems and intervening in time, thereby promoting the appropriate use of treatment (Xu et al., 2022b). We evaluated the appropriateness of antibiotic use choices against guidelines and constructed an AHP weighting system to quantify the rational use of antibiotics (Tunkel et al., 2004; Tunkel et al., 2008; Tunkel et al., 2017). We found a significant difference in the rational antibiotic use scores between the two groups, indicating that pharmacist services effectively improved the appropriateness of antibiotic use. This finding also shows that the standardization of physician prescribing still needs to be improved. A retrospective study found similar results: AMS services were associated with significant reductions in antibiotic use, antibiotic costs, and inappropriate antibiotic prescribing (Xu et al., 2022a). By analyzing the intensity of antibiotic use, we found that pharmacist services were effective in reducing the intensity of antibiotic use, a view supported by previous studies (Jourdan et al., 2018). In addition, regarding medication adherence, we found that after the pharmacist’s services, there was a significant reduction in the AUD of linezolid and miscellaneous agents. At the same time, the use of vancomycin, ceftriaxone, and meropenem in combination therapy increased. Selecting an appropriate antibiotic regimen for CNSI is critical to treatment success. Usually, vancomycin plus an anti-pseudomonal beta-lactam (such as cefepime, ceftazidime, or meropenem) is recommended as empiric therapy for healthcare-associated ventriculitis and meningitis; the choice of empiric beta-lactam agent should be based on local in vitro susceptibility patterns. For the treatment of patients with CNSI caused by staphylococci in whom vancomycin cannot be used, linezolid is recommended (Tunkel et al., 2017). Pharmacists ensuring that the number and types of antimicrobial agents provided in the treatment plan available are appropriate for the patient population served is one of the most critical responsibilities in the AMS program (Lai et al., 2022). Our results indicate that clinical pharmacists play a key role in the rational use of antimicrobial agents, which is consistent with other research (Gu et al., 2023). In addition, the rate of antibiotic switching also reflects the appropriateness of the choice of treatment regimen; frequent changes and combinations of antibiotics also mean that physicians are concerned about treatment failure and are not confident in their choice of antibiotics or that the treatment regimen is not the standard guideline-recommended regimen (Livorsi et al., 2015; Gebretekle et al., 2018). Our study found that the pharmacist services group had a significantly reduced rate of antibiotic switching, suggesting that pharmacists play a facilitating role in selecting an appropriate initial regimen. Pharmacist services ensured the regularity of physician prescribing behavior, the continuity of the initial treatment regimen, and increased physician confidence in the antibiotic regimen (Woit et al., 2020).

Most of the current literature (Weant et al., 2009) suggests that pharmacist services effectively reduce antibiotic costs, but our study did not find a significant difference between the two groups. Although the pharmacy services effectively reduced the total AUD, there was no significant reduction in drug costs due to the different prices of different antibiotics. Although the hospitalization costs of patients with pharmacist services were higher than the group without pharmacist involvement, the rate of improvement was higher in the pharmacist services group. The results of the CEA then showed that the pharmacy services group was highly cost-effective and that the increased costs were acceptable. Similarly, a study conducted in Thailand found that pharmacist intervention in the healthcare team to participate in the treatment plan is cost-effective and can prolong patients’ lives and improve their quality of life (Arunmanakul et al., 2022). From the hospital’s perspective, pharmacy services have not reduced direct healthcare costs. Still, it presented savings for forecast costs related to preventable morbidities, measuring an excellent cost-benefit ratio for the public health sector (Cazarim et al., 2020). The pharmacist services also did not significantly reduce the LOS, which is inconsistent with the literature (Nielsen et al., 2017). The LOS is primarily influenced by the treatment characteristics of CNSI, which are difficult to cure and take a long time to treat (Dorsett and Liang, 2016). Multiple factors contribute to the discrepancy in hospitalization costs, such as the price of guideline-recommended vancomycin is much higher than that of linezolid in China, which may be the main reason.

The results of this study show that a clinical pharmacist-led antibiotic stewardship program successfully promoted the rational use of antibiotics and improved treatment outcomes. In order to improve the rational use of medication and therapeutic outcomes in the clinic, there is a need to increase the number of clinical pharmacists and improve the competence of clinical pharmacists. So, health systems need to increase the number of clinical pharmacists and provide standardized training, etc. From a clinical pharmacist’s perspective, a qualified clinical pharmacist should engage in clinical practice, medication therapy management, patient monitoring, etc.

4.2 Study strengths and limitations

Our study is an assessment project led by clinical pharmacists on neurosurgical anti-infective treatments to assess their effectiveness and appropriateness. Clinical pharmacists play an essential role in developing patient anti-infection protocols and in reducing antibiotic resistance rates. Clinical pharmacists providing pharmaceutical care to neurocritical care patients improve patient care and reduce clinical risk (Bourne and Dorward, 2011). A recent systematic review showed that pharmacist services could significantly improve the acceptability and effectiveness of treatment for infectious diseases (Zhang et al., 2020a). Pharmacists are playing an increasingly important role in clinical practice, and thanks to the clinical pharmacist training program launched in China, pharmacists are equipped with professional drug knowledge and clinical experience through professional training and play a role in bridging the gap between doctors and patients and drugs, providing personalized anti-infection programs based on understanding patients’ conditions, reviewing doctors’ prescriptions to correct medication errors, and playing a greater role in patient monitoring than busy doctors and nurses.

Compared with previous studies (Weant et al., 2009), our study focused more on evaluating the therapeutic efficacy and appropriateness of anti-infective regimens after pharmacist services. The pharmacist services model was based on the AMS strategy, and the effectiveness of the services was ensured by standardized processes, clear delineation, and practical implementation methods. Our findings suggest the high value and clinical utility of participation in a clinical pharmacist service for patients with neurosurgical CNSI in general hospitals.

This study has several limitations. First, this was a single-center study with a relatively small sample size. Each medical setting has different patterns of collaboration between clinical pharmacists and neurosurgeons and different work priorities, resulting in different roles. Second, the impact of clinical outcomes such as long-term survival rates, reinfection rates, and resistance rates could not be estimated due to the need to collect such data, and we were unable to assess the long-term effects of the AMS Program due to the short duration of the study.

5 Conclusion

This study demonstrates that the participation of clinical pharmacists in the neurosurgery department of a general hospital can increase the rational use of antibiotics, improve treatment outcomes, and reduce the intensity of antibiotic use. Nevertheless, such participation has failed to reduce the antibiotic costs of patients and decrease the length of hospital stays. These results need to be confirmed in further studies.

$\mathit{D}\mathit{D}\mathit{D}\mathit{s}=\frac{\mathit{a}\mathit{c}\mathit{c}\mathit{u}\mathit{m}\mathit{u}\mathit{l}\mathit{a}\mathit{t}\mathit{e}\mathit{d}\mathit{d}\mathit{r}\mathit{u}\mathit{g}\mathit{u}\mathit{s}\mathit{e}\left(\mathit{g}\right)}{\mathit{d}\mathit{e}\mathit{f}\mathit{i}\mathit{n}\mathit{e}\mathit{d}\mathit{d}\mathit{a}\mathit{i}\mathit{l}\mathit{y}\mathit{d}\mathit{o}\mathit{s}\mathit{e}}$

$\mathit{A}\mathit{U}\mathit{D}=\frac{\mathit{D}\mathit{D}\mathit{D}\mathit{s}\mathit{o}\mathit{f}\mathit{s}\mathit{p}\mathit{e}\mathit{c}\mathit{i}\mathit{f}\mathit{i}\mathit{c}\mathit{a}\mathit{n}\mathit{t}\mathit{i}\mathit{b}\mathit{i}\mathit{o}\mathit{t}\mathit{i}\mathit{c}\mathit{t}\mathit{y}\mathit{p}\mathit{e}\mathit{s}}{\mathit{n}\mathit{u}\mathit{m}\mathit{b}\mathit{e}\mathit{r}\mathit{o}\mathit{f}\mathit{d}\mathit{a}\mathit{y}\mathit{s}\mathit{s}\mathit{p}\mathit{e}\mathit{n}\mathit{t}\mathit{i}\mathit{n}\mathit{b}\mathit{e}\mathit{d}\left(\mathit{d}\mathit{a}\mathit{y}\right)}\times \mathbf{100}$

$\mathit{A}\mathit{U}\mathit{D}\left(\%\right)=\frac{\mathit{A}\mathit{U}\mathit{D}\mathit{o}\mathit{f}\mathit{s}\mathit{p}\mathit{e}\mathit{c}\mathit{i}\mathit{f}\mathit{i}\mathit{c}\mathit{a}\mathit{n}\mathit{t}\mathit{i}\mathit{b}\mathit{i}\mathit{o}\mathit{t}\mathit{i}\mathit{c}\mathit{t}\mathit{y}\mathit{p}\mathit{e}\mathit{s}}{\mathit{t}\mathit{o}\mathit{t}\mathit{a}\mathit{l}\mathit{A}\mathit{U}\mathit{D}\mathit{o}\mathit{f}\mathit{a}\mathit{l}\mathit{l}\mathit{a}\mathit{n}\mathit{t}\mathit{i}\mathit{b}\mathit{i}\mathit{o}\mathit{t}\mathit{i}\mathit{c}\mathit{t}\mathit{y}\mathit{p}\mathit{e}\mathit{s}}\times \mathbf{100}\%$

$\mathit{A}\mathit{U}\mathit{D}\mathit{d}\mathit{e}\mathit{s}\mathit{c}\mathit{e}\mathit{n}\mathit{d}\mathit{e}\mathit{r}\left(\%\right)=\mathit{A}\mathit{U}\mathit{D}\%\mathit{i}\mathit{n}\mathit{g}\mathit{r}\mathit{o}\mathit{u}\mathit{p}\mathit{w}\mathit{i}\mathit{t}\mathit{h}\mathit{o}\mathit{u}\mathit{t}\mathit{p}\mathit{h}\mathit{a}\mathit{r}\mathit{m}\mathit{a}\mathit{c}\mathit{i}\mathit{s}\mathit{t}\mathit{p}\mathit{a}\mathit{r}\mathit{t}\mathit{i}\mathit{c}\mathit{i}\mathit{p}\mathit{a}\mathit{t}\mathit{i}\mathit{o}\mathit{n}-\mathit{A}\mathit{U}\mathit{D}\%\mathit{i}\mathit{n}\mathit{p}\mathit{h}\mathit{a}\mathit{r}\mathit{m}\mathit{a}\mathit{c}\mathit{y}\mathit{s}\mathit{e}\mathit{r}\mathit{v}\mathit{i}\mathit{c}\mathit{e}\mathit{s}\mathit{g}\mathit{r}\mathit{o}\mathit{u}\mathit{p}$

Data availability statement

The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by The Ethics Committee of the First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital (approval number: 2023S357). The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required from the participants or the participants’ legal guardians/next of kin in accordance with the national legislation and institutional requirements.

Author contributions

The authors confirm their contribution to the paper as follows: study conception and design: XC; data collection: CD, XL, and JW; analysis and interpretation of results: XH and YL; draft manuscript preparation: JC. All authors reviewed the results and approved the final version of the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by funding of Shandong Provincial Pharmaceutical Society Hospital Pharmacy Special Research Academic Activity Project (yyyx2021ms-03); Inner Mongolia Natural Science Foundation (2022QN08015); Qin Wenbin Natural Science Foundation (BYJJ-QWB202013).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Álvarez-Lerma, F., Grau, S., Echeverría-Esnal, D., Martínez-Alonso, M., Gracia-Arnillas, M. P., Horcajada, J. P., et al. (2018). A before-and-after study of the effectiveness of an antimicrobial stewardship program in critical care. Antimicrob. Agents Chemother. 62, e018255–e1917. doi:10.1128/AAC.01825-17

CrossRef Full Text | Google Scholar

Archibald, L. K., and Quisling, R. G. (2013). Central nervous system infections. Textb. Neurointensive Care, 427–517. doi:10.1007/978-1-4471-5226-2_22

CrossRef Full Text | Google Scholar

Arunmanakul, P., Chaiyakunapruk, N., Phrommintikul, A., Ruengorn, C., and Permsuwan, U. (2022). Cost-effectiveness analysis of pharmacist interventions in patients with heart failure in Thailand. J. Am. Pharm. Assoc. 62, 71–78. doi:10.1016/j.japh.2021.10.005

CrossRef Full Text | Google Scholar

Barlam, T. F., Cosgrove, S. E., Abbo, L. M., MacDougall, C., Schuetz, A. N., Septimus, E. J., et al. (2016). Executive summary: Implementing an antibiotic stewardship program: Guidelines by the infectious diseases society of America and the society for healthcare epidemiology of America. Clin. Infect. Dis. 62, 1197–1202. doi:10.1093/cid/ciw217

PubMed Abstract | CrossRef Full Text | Google Scholar

Bourne, R. S., and Dorward, B. J. (2011). Clinical pharmacist interventions on a UK neurosurgical critical care unit: A 2-week service evaluation. Int. J. Clin. Pharm. 33, 755–758. doi:10.1007/s11096-011-9538-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Cazarim, M. D. S., Rodrigues, J. P. V., Calcini, P. S., Einarson, T., and Pereira, L. R. L. (2020). Cost-benefit analysis of pharmacist interventions over 36 months in a university hospital. Rev. saúde pública 54, 94. doi:10.11606/s1518-8787.2020054001895

PubMed Abstract | CrossRef Full Text | Google Scholar

CDC (2019). Core elements of hospital antibiotic stewardship programs. Available at: https://www.cdc.gov/antibiotic-use/core-elements/hospital.html (Accessed August 13, 2023).

Google Scholar

China Hospital Association Clinical Pharmacist Training Expert Steering Committee (2008). Clinical pharmacist training guide. China Hospital Association.

Google Scholar

China National Bureau of Statistics, (2023). Statistical bulletin of the people’s Republic of China on national economic and social development 2022. China National Bureau of Statistics. Available at: http://www.stats.gov.cn/sj/zxfb/202302/t20230228_1919011.html (Accessed August 17, 2023).

Google Scholar

Dellit, T. H., Owens, R. C., McGowan, J. E., Gerding, D. N., Weinstein, R. A., Burke, J. P., et al. (2007). Infectious diseases society of America and the society for healthcare epidemiology of America guidelines for developing an institutional program to enhance antimicrobial stewardship. Clin. Infect. Dis. 44, 159–177. doi:10.1086/510393

PubMed Abstract | CrossRef Full Text | Google Scholar

Dorsett, M., and Liang, S. Y. (2016). Diagnosis and treatment of central nervous system infections in the emergency department. Emerg. Med. Clin. N. Am. 34, 917–942. doi:10.1016/j.emc.2016.06.013

CrossRef Full Text | Google Scholar

Falamić, S., Lucijanić, M., Hadžiabdić, M. O., Marušić, S., and Bačić Vrca, V. (2018). Pharmacist’s interventions improve time in therapeutic range of elderly rural patients on warfarin therapy: A randomized trial. Int. J. Clin. Pharm. 40, 1078–1085. doi:10.1007/s11096-018-0691-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Gallagher, J., McCarthy, S., and Byrne, S. (2014). Economic evaluations of clinical pharmacist interventions on hospital inpatients: A systematic review of recent literature. Int. J. Clin. Pharm. 36, 1101–1114. doi:10.1007/s11096-014-0008-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Gebretekle, G. B., Haile Mariam, D., Abebe, W., Amogne, W., Tenna, A., Fenta, T. G., et al. (2018). Opportunities and barriers to implementing antibiotic stewardship in low and middle-income countries: Lessons from a mixed-methods study in a tertiary care hospital in Ethiopia. PLoS ONE 13, e0208447. doi:10.1371/journal.pone.0208447

PubMed Abstract | CrossRef Full Text | Google Scholar

Greenberg, R. G., Smith, P. B., Cotten, C. M., Moody, M. A., Clark, R. H., and Benjamin, D. K. J. (2008). Traumatic lumbar punctures in neonates: Test performance of the cerebrospinal fluid white blood cell count. Pediatr. Infect. Dis. J. 27, 1047–1051. doi:10.1097/INF.0b013e31817e519b

PubMed Abstract | CrossRef Full Text | Google Scholar

Greenwood, J. C., Gutierrez, K., and McDermott, M. (2023). Results of a pilot study for a pharmacy discharge review in neurosurgical patients: A quality-safety initiative. Cureus 15, e36067. doi:10.7759/cureus.36067

PubMed Abstract | CrossRef Full Text | Google Scholar

Gu, H., Sun, L., Sheng, B., Gu, X., Wang, S., Liu, L., et al. (2023). Benefits of pharmacist intervention in the critical care patients with infectious diseases: A propensity score matching retrospective cohort study. Australian Critical Care. S1036731422002570. doi:10.1016/j.aucc.2022.12.011

CrossRef Full Text | Google Scholar

Hernández Ortiz, O. H., García García, H. I., Muñoz Ramírez, F., Cardona Flórez, J. S., Gil Valencia, B. A., Medina Mantilla, S. E., et al. (2018). Development of a prediction rule for diagnosing postoperative meningitis: A cross-sectional study. J. Neurosurg. 128, 262–271. doi:10.3171/2016.10.JNS16379

PubMed Abstract | CrossRef Full Text | Google Scholar

Horan, T. C., Andrus, M., and Dudeck, M. A. (2008). CDC/NHSN surveillance definition of health care–associated infection and criteria for specific types of infections in the acute care setting. Am. J. Infect. Control 36, 309–332. doi:10.1016/j.ajic.2008.03.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Hu, F.-P., Guo, Y., Zhu, D.-M., Wang, F., Jiang, X.-F., Xu, Y.-C., et al. (2016). Resistance trends among clinical isolates in China reported from CHINET surveillance of bacterial resistance, 2005–2014. Clin. Microbiol. Infect. 22, S9–S14. doi:10.1016/j.cmi.2016.01.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Jourdan, J.-P., Muzard, A., Goyer, I., Ollivier, Y., Oulkhouir, Y., Henri, P., et al. (2018). Impact of pharmacist interventions on clinical outcome and cost avoidance in a university teaching hospital. Int. J. Clin. Pharm. 40, 1474–1481. doi:10.1007/s11096-018-0733-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Khan, I., Pintelon, L., and Martin, H. (2022). The application of multicriteria decision analysis methods in health care: A literature review. Med. Decis. Mak. 42, 262–274. doi:10.1177/0272989X211019040

CrossRef Full Text | Google Scholar

Kim, S., Kim, H., and Suh, H. S. (2022). Priorities in the prevention strategies for medication error using the analytical hierarchy process method. Healthcare 10, 512. doi:10.3390/healthcare10030512

PubMed Abstract | CrossRef Full Text | Google Scholar

Lai, W. M., Islahudin, F. H., Ambaras Khan, R., and Chong, W. W. (2022). Pharmacists’ perspectives of their roles in antimicrobial stewardship: A qualitative study among hospital pharmacists in Malaysia. Antibiotics 11, 219. doi:10.3390/antibiotics11020219

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, W., Zeng, L., Li, J., Huang, L., Gui, G., Song, J., et al. (2017). Development of indicators for assessing rational drug use to treat community-acquired pneumonia in children in hospitals and clinics: A modified delphi study. Medicine 96, e9308. doi:10.1097/MD.0000000000009308

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, Y., Lu, W., Zheng, X., Zhang, L., Dong, W., Zhao, X., et al. (2022). Norvancomycin for the treatment of central nervous system mrsa infections: A randomized controlled trial. Eur. J. Pharm. Sci. 177, 106266. doi:10.1016/j.ejps.2022.106266

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, Z., Wu, X., Yu, J., Wu, X., Du, Z., Sun, Y., et al. (2016). Empirical combination antibiotic therapy improves the outcome of nosocomial meningitis or ventriculitis in neuro-critical care unit patients. Surg. Infect. 17, 465–472. doi:10.1089/sur.2015.060

PubMed Abstract | CrossRef Full Text | Google Scholar

Livorsi, D., Comer, A., Matthias, M. S., Perencevich, E. N., and Bair, M. J. (2015). Factors influencing antibiotic-prescribing decisions among inpatient physicians: A qualitative investigation. Infect. Control Hosp. Epidemiol. 36, 1065–1072. doi:10.1017/ice.2015.136

PubMed Abstract | CrossRef Full Text | Google Scholar

Mobinizadeh, M., Raeissi, P., Nasiripour, A. A., Olyaeemanesh, A., and Tabibi, S. J. (2016). A model for priority setting of health technology assessment: The experience of AHP-TOPSIS combination approach. DARU J. Pharm. Sci. 24, 10. doi:10.1186/s40199-016-0148-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Nielsen, T. R. H., Honoré, P. H., Rasmussen, M., and Andersen, S. E. (2017). Clinical effects of a pharmacist intervention in acute wards – a randomized controlled trial. Basic and Clin. Pharmacol. Toxicol. 121, 325–333. doi:10.1111/bcpt.12802

CrossRef Full Text | Google Scholar

Pan, S., Huang, X., Wang, Y., Li, L., Zhao, C., Yao, Z., et al. (2018). Efficacy of intravenous plus intrathecal/intracerebral ventricle injection of polymyxin B for post-neurosurgical intracranial infections due to MDR/XDR acinectobacter baumannii: A retrospective cohort study. Antimicrob. Resist Infect. Control 7, 8. doi:10.1186/s13756-018-0305-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Rattanavipanon, W., Chaiyasothi, T., Puchsaka, P., Mungkornkaew, R., Nathisuwan, S., Veettil, S. K., et al. (2022). Effects of pharmacist interventions on cardiovascular risk factors and outcomes: An umbrella review of meta-analysis of randomized controlled trials. Br. J. Clin. Pharmacol. 88, 3064–3077. doi:10.1111/bcp.15279

PubMed Abstract | CrossRef Full Text | Google Scholar

Saaty, T. L. (1990). How to make a decision: The analytic hierarchy process. Eur. J. Operational Res. 48, 9–26. doi:10.1016/0377-2217(90)90057-i

CrossRef Full Text | Google Scholar

Saseen, J. J., Ripley, T. L., Bondi, D., Burke, J. M., Cohen, L. J., McBane, S., et al. (2017). ACCP clinical pharmacist competencies. Pharmacotherapy 37, 630–636. doi:10.1002/phar.1923

PubMed Abstract | CrossRef Full Text | Google Scholar

Shun-xiao, S., Wei-yue, G., and Lian-sheng, L. (2020). Research progress in the treatment of intracranial infections with antibiotics. Chin. J. ANTIBIOTICS 45, 861–866.

Google Scholar

Skelton, J. B., and Binaso, K. A. (2012). DOTx.MED: Pharmacist-delivered interventions to improve care for patients with diabetes. J. Am. Pharm. Assoc. 52, 25–37. doi:10.1331/JAPhA.2012.12501

PubMed Abstract | CrossRef Full Text | Google Scholar

Sonneville, R., Magalhaes, E., and Meyfroidt, G. (2017). Central nervous system infections in immunocompromised patients. Curr. Opin. Crit. Care 23, 128–133. doi:10.1097/MCC.0000000000000397

PubMed Abstract | CrossRef Full Text | Google Scholar

Tan, Y. C., Gill, A. K., and Kim, K. S. (2015). Treatment strategies for central nervous system infections: An update. Expert Opin. Pharmacother. 16, 187–203. doi:10.1517/14656566.2015.973851

PubMed Abstract | CrossRef Full Text | Google Scholar

Tang, J., Liang, Y., O’Neill, C., Kee, F., Jiang, J., and Congdon, N. (2019). Cost-effectiveness and cost-utility of population-based glaucoma screening in China: A decision-analytic markov model. Lancet Glob. Health 7, e968–e978. doi:10.1016/S2214-109X(19)30201-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Tunkel, A. R., Glaser, C. A., Bloch, K. C., Sejvar, J. J., Marra, C. M., Roos, K. L., et al. (2008). The management of encephalitis: Clinical practice guidelines by the infectious diseases society of America. Clin. Infect. Dis. 47, 303–327. doi:10.1086/589747

PubMed Abstract | CrossRef Full Text | Google Scholar

Tunkel, A. R., Hartman, B. J., Kaplan, S. L., Kaufman, B. A., Roos, K. L., Scheld, W. M., et al. (2004). Practice guidelines for the management of bacterial meningitis. Clin. Infect. Dis. 39, 1267–1284. doi:10.1086/425368

PubMed Abstract | CrossRef Full Text | Google Scholar

Tunkel, A. R., Hasbun, R., Bhimraj, A., Byers, K., Kaplan, S. L., Scheld, W. M., et al. (2017). 2017 infectious diseases society of America’s clinical practice guidelines for healthcare-associated ventriculitis and meningitis. Clin. Infect. Dis. 64, e34–e65. doi:10.1093/cid/ciw861

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, N. (2021). Chinese expert consensus on the diagnosis and treatment of central nervous system infections in neurosurgery. Chin. J. Neurosurg. 37, 2–15. doi:10.3760/cma.j.cn112050-20200831-00480

CrossRef Full Text | Google Scholar

Wang, Y., Zhou, C., Liu, C., Liu, S., Liu, X., and Li, X. (2022). The impact of pharmacist-led antimicrobial stewardship program on antibiotic use in a county-level tertiary general hospital in China: A retrospective study using difference-in-differences design. Front. Public Health 10, 1012690. doi:10.3389/fpubh.2022.1012690

PubMed Abstract | CrossRef Full Text | Google Scholar

Warden, B. A., Shapiro, M. D., and Fazio, S. (2019). The role of the clinical pharmacist in a preventive cardiology practice. Ann. Pharmacother. 53, 1214–1219. doi:10.1177/1060028019864669

PubMed Abstract | CrossRef Full Text | Google Scholar

Weant, K. A., Armitstead, J. A., Ladha, A. M., Sasaki-Adams, D., Hadar, E. J., and Ewend, M. G. (2009). Cost effectiveness of A clinical pharmacist on A neurosurgical team. Neurosurgery 65, 946–950. doi:10.1227/01.NEU.0000347090.22818.35

PubMed Abstract | CrossRef Full Text | Google Scholar

WHO (2022). WHO collaborating centre for drug statistics methodology, guidelines for ATC classification and DDD assignment 2023 (oslo, Norway).

Google Scholar

Woit, C., Yuksel, N., and Charrois, T. L. (2020). Competence and confidence with prescribing in pharmacy and medicine: A scoping review. Int. J. Pharm. Pract. 28, 312–325. doi:10.1111/ijpp.12595

PubMed Abstract | CrossRef Full Text | Google Scholar

Xu, J., Huang, J., Yu, Y., Zhou, D., Wang, Y., Xue, S., et al. (2022a). The impact of a multifaceted pharmacist-led antimicrobial stewardship program on antibiotic use: Evidence from a quasi-experimental study in the department of vascular and interventional radiology in a Chinese tertiary hospital. Front. Pharmacol. 13. doi:10.3389/fphar.2022.832078

CrossRef Full Text | Google Scholar

Xu, J., Peng, T., Xie, M., and Kong, L. (2022b). Pharmacist-led intervention in managing unreasonable use of apatinib based on AHP-TOPSIS analysis. Lat. Am. J. Pharm.

Google Scholar

Younger, D. S., and Coyle, P. K. (2019). Central nervous system vasculitis due to infection. Neurol. Clin. 37, 441–463. doi:10.1016/j.ncl.2019.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, J., Li, X., Xie, J., and Zheng, W. (2020a). Evaluation of a clinical pharmacist consultation service for patients with infectious diseases in China: A systematic review and meta-analysis. Eur. J. Hosp. Pharm. 27, 131–136. doi:10.1136/ejhpharm-2018-001815

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, J., Xu, C., Zheng, W., He, R., Xie, J., Qian, X., et al. (2020b). The clinical pharmacist-led consultation for infectious diseases in guizhou Province, China: A survey among hospital pharmacies. Front. Pharmacol. 11, 149. doi:10.3389/fphar.2020.00149

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, Z., Song, Y., Kang, J., Duan, S., Li, Q., Feng, F., et al. (2021). Epidemiology of patients with central nervous system infections, mainly neurosurgical patients: A retrospective study from 2012 to 2019 in a teaching hospital in China. BMC Infect. Dis. 21, 826. doi:10.1186/s12879-021-06561-2

PubMed Abstract | CrossRef Full Text | Google Scholar