Skip to main content

ORIGINAL RESEARCH article

Front. Reprod. Health, 21 January 2025
Sec. HIV and STIs
This article is part of the Research Topic Accelerating to 2030 – Doubling Down on HIV Prevention to End HIV/AIDS as a Public Health Threat View all 10 articles

Engaging the private sector as part of HIV pre-exposure prophylaxis service delivery in Vietnam: a comparative analysis of uptake, persistence and HIV seroconversion from 2018 to 2023

\r\nBao Ngoc Vu
Bao Ngoc Vu1*Kimberly GreenKimberly Green1Huong PhanHuong Phan2Long TranLong Tran1Phuong PhanPhuong Phan1Tham TranTham Tran1Linh DoanLinh Doan2Yen VuYen Vu1Chau PhamChau Pham1Dao NguyenDao Nguyen3Anh DoanAnh Doan3Trang NgoTrang Ngo3Phuong TranPhuong Tran4Vuong NguyenVuong Nguyen4Bieu NguyenBieu Nguyen1Thai PhanThai Phan4Ha Nguyen\r\nHa Nguyen1
  • 1Southeast Asia Hub, PATH, Hanoi, Vietnam
  • 2Ministry of Health, Vietnam Administration of HIV/AIDS Control, Hanoi, Vietnam
  • 3Office of Health, United States Agency for International Development (Vietnam), Hanoi, Vietnam
  • 4Southeast Asia Hub, PATH, Ho Chi Minh City, Vietnam

Background: In Vietnam, PrEP was introduced in 2017 and scaled up from 2019. Private sector engagement (PSE) in PrEP service delivery was deployed as a strategy from the start to increase PrEP access. We assessed the effectiveness of this approach to inform ongoing efforts to accelerate epidemic control by 2030.

Methods: We implemented a process evaluation with longitudinal design using retrospective programmatic data collected and uploaded onto a secure online system (HMED) from 23 public and 17 private PrEP clinics in Hanoi, Ho Chi Minh City (HCMC), and Dong Nai. We measured the effectiveness of PrEP service delivery by PrEP initiation/reinitiation, uptake, persistence, discontinuation, and HIV seroconversion. We used the Kaplan-Meier time-to-event approach to estimate PrEP persistence and mixed-effects logistic regression analysis to assess factors associated with the PrEP persistence.

Results: From October 2017 to September 2023, 29,944 individuals initiated PrEP, and among these, 79.3% started PrEP at a private sector clinic while 20.7% initiated in a public sector clinic. The median duration of PrEP use persistence at private clinics was significantly longer than that at public clinics (268 days vs. 148 days, respectively). Mixed-effects logistic regression analysis results indicated a significant statistical association between PrEP persistence for at least three months and initiating PrEP at a private clinic [adjusted odds ratio [aOR] = 4.28; 95% confidence interval [CI]: 2.96–6.19], opting for TelePrEP (aOR = 3.42; 95% CI: 2.12–5.53), or being 20 years of age or older (aOR = 1.86; 95% CI: 1.62–2.13). HIV seroconversion was significantly lower among PrEP users at private clinics compared to public clinics (0.03 vs. 0.13 per 100 person-years, respectively; p < 0.01).

Conclusion: Offering choice in PrEP service delivery options is essential to increase access and uptake. Private-sector PrEP providers play a pivotal role in increasing PrEP uptake and coverage in Vietnam, and will be critical to delivery of new long-acting options.

1 Introduction

PrEP is a high impact HIV prevention tool that could drive HIV transmission toward elimination if scaled up to achieve high coverage (1). Although oral pre-exposure prophylaxis (PrEP) has been proven to be highly effective in preventing HIV infection, global PrEP uptake has been inadequate to effectively accelerate progress towards HIV epidemic control in many parts of the world (1, 2). While the total number of people using PrEP globally has risen from over 233 000 in 2019 to over 3.5 million in 2023, large-scale PrEP coverage remains limited to a small number of countries (3). This represents only 35% of the global PrEP target of ten million set for 2025 (3). According to the UNAIDS Global AIDS Monitoring 2023, the largest gap in PrEP uptake is in Asia-Pacific, where nearly a quarter of new HIV infections occurred in 2022 (3). Scaling up PrEP uptake requires innovations in differentiated, simplified, demedicalized and integrated models of care, along with enabling service convenience, choice and confidentiality to ensure that all those who need PrEP can access it (4).

Leveraging the private sector as part of HIV service delivery can enhance person-centered care, diversify funding streams, fosters innovation, and improve the efficiency and sustainability of the HIV response (5, 6). Private sector health care providers may include private hospitals and clinics, pharmacies, drug shops, social-enterprises, community-based organizations, and onsite, mobile and telehealth services. While the World Health Organization (WHO), the President's Emergency Plan for AIDS Relief (PEPFAR), the Global Fund (GF), the United States Agency for International Development (USAID), country leaders and others have called for greater PSE to optimize HIV service choice and sustainability, overall access to private sector HIV services remains limited in many settings (5, 79).

As part of efforts to increase service options and domestic financing, low and middle income countries (LMIC) are increasingly engaging private sector service providers, including private clinics and pharmacies, in the delivery of PrEP services through either pure commercial, partial subsidy/mixed financing models or free service mechanisms. Studies across Asia-Pacific (i.e., Australia, New Zealand, India, Philippines, Taiwan, Thailand and Vietnam) and USA and Africa (i.e., South Africa and Kenya) indicate that private sector PrEP services are acceptable in the settings where they've been offered, and that private service providers are capable of safely starting and managing clients on PrEP, reaching more individuals typically underserved by public-sector clinics and increasing overall PrEP coverage (5, 10). Despite this PrEP is commonly delivered at public sector health facilities, while private sector PrEP service delivery is often limited to small scale pilots. There are also concerns about the uneven quality and affordability of private sector health services (11, 12). In all, little is known about PrEP service delivery at private sector health facilities.

Recognizing the importance of PrEP, the government of Vietnam adopted the WHO recommendation to implement oral PrEP as one of the key interventions in the National Strategy for Ending AIDS by 2030 (13, 14)1. PrEP was introduced in Vietnam in 2017 through the Prepped for PrEP (P4P) pilot, and the Ministry of Health (MOH) approved and implemented two national PrEP scale-up plans for the period 2018–2020 and 2021–2025, with the goal of achieving PrEP coverage for 30% of total MSM by 2025 (15, 16)1. These national PrEP scale-up plans, funded by PEPFAR and the GF, have been supported by international development organizations (WHO, USAID, and the US CDC) and global health organizations, such as PATH and FHI 360. Vietnam is a leading country in Southeast Asia, after Thailand, in implementing a policy and national program for PrEP soon after the WHO recommendation in 2015. As of 2023, 67,191 people have received PrEP at least once in the last 12 months ranking Vietnam first in PrEP uptake in the Asia-Pacific region significantly ahead of Australia and Thailand (3).

Learning from the P4P pilot (4), the Vietnam Administration of HIV/AIDS Control (VAAC), which is tasked by the Ministry of Health to lead the national PrEP scale-up plan, encouraged provinces and cities to engage private sector service providers in PrEP implementation and put in place guidelines to simplify PrEP delivery in private sector clinics. To date, 219 clinics (170 public and 49 private) offer PrEP services across 29 out of 63 provinces in the country. Notably, private clinics, which accounted for just one-fifth (22.3%) of total PrEP clinics, served nearly half (48%) of total PrEP clients in the country. However, the scale and scope of PSE in PrEP service delivery varies across provinces and cities in Vietnam.

This paper aims to generate evidence on the PSE approach to PrEP service delivery in a real-world setting. In this paper, we present findings from an analysis of routine programmatic data to assess the effectiveness of private sector engagement in PrEP service delivery, implemented in three provinces (Hanoi, Ho Chi Minh City, and Dong Nai) and supported by PEPFAR through the USAID/PATH Healthy Markets and USAID/PATH Support for Technical Excellence and Private Sector Sustainability in Vietnam (STEPS) projects.

2 Materials and methods

2.1 Study design and data source

We conducted an analysis of routine programmatic data among PrEP users enrolled in forty clinics (23 public and 17 private sector) in three provinces (Hanoi, Ho Chi Minh City, and Dong Nai) to assess the effectiveness of private sector engagement in PrEP service delivery compared to public sector PrEP service delivery. The forty sites included in the analysis represent all clinics supported by PEPFAR through USAID/PATH Healthy Markets and USAID/PATH STEPS projects from 01 October 2018 to 30 September 2023 in the three above mentioned provinces. Routine M&E data from all clients enrolled on PrEP were included in the analysis. Data available included client enrollment, continuation/persistence on PrEP, and HIV sero-conversion. We extracted data from aggregated service monitoring reports at the following time periods: PrEP initiation (T0) and every follow-up visit at month one (M1), three months (M3), six months (M6), nine months (M9) and 12 months (M12). In this analysis, we defined the effectiveness of PrEP service delivery as the ability to enroll and maintain people on PrEP, and to prevent HIV acquisition (17). Respective indicators for measurement of PrEP service delivery effectiveness were: (1) PrEP uptake; (2) PrEP persistence rate at month 3 (M3) and ongoing persistence; and (3) HIV seroconversion rate at the month one and at follow-up visits.

2.2 Description of the PrEP service delivery at public and private clinics

The PrEP program was implemented in three provinces (Hanoi, Ho Chi Minh City, and Dong Nai), which were purposively selected based on high HIV burden, the largest number of key populations (KP), such as men who have sex with men (MSM), people who inject drugs (PWID), female sex workers (FSW), and transgender women (TGW), and the United States President's Emergency Plan for AIDS Relief (PEPFAR) epidemic control investments in these locations. We engaged a total of 40 clinics, including 23 public and 17 private clinics in delivery of PrEP services. PrEP at public clinics was delivered at the outpatient clinics located at district health centers which were originally established to provide antiretroviral therapy (ART), while PrEP at private clinics was offered at KP-led or KP friendly clinics as part of a primary health care (PHC) one-stop shop (OSS) approach providing person-centered care services, including HIV testing, post-exposure prophylaxis (PEP), sexually transmitted infection (STI) testing and treatment, ART, hepatitis B and C testing and treatment, noncommunicable disease management, mental health services and/or transgender-affirming care. Public clinics provided on-site PrEP services serving clients who were referred to or linked by key population community-based organizations (KP CBOs) and HIV counseling and testing (HCT) centers or were walk-in clients. Taking advantage of having their own network of peer educators or a partnership with KP CBOs, four out of 17 private clinics offered mobile and/or TelePrEP in addition to on-site services for clients living far away or unable to visit the clinic for PrEP initiation and/or follow-up. Free oral PrEP services were provided at all public and private clinics, while private clinics also offered a fee-based PrEP option. KP CBOs played a critical role in providing information about PrEP to clients who tested HIV negative, conducting a pre-screen for eligibility and then referring these clients for PrEP services at public or private clinics. In addition, because most KP CBOs are heavily engaged online, they posted information on PrEP and where to go for PrEP services on their social media and websites. PrEP services were consistently advertised online through two separate dedicated Facebook pages—Rainbow Village reaching MSM and Be Me Be Happy reaching TGW. These Facebook pages included online peer influencers who screened for HIV testing and PrEP needs and made direct referrals to the KP-led clinics. An online HIV self-testing and PrEP self-screener also supported client awareness of and linkages to PrEP.

Clinic staff, including clinicians, pharmacists, counselors, and lab technicians, received a three-day training to provide daily oral PrEP and on-demand PrEP following the national guidelines on HIV care and treatment.2 Based on the national guidelines, the PrEP program dispensed oral tenofovir disoproxil fumarate and emtricitabine (TDF/FTC 300 mg/200 mg) as a fixed-dose combination and needed a clinical follow-up visit one month after PrEP initiation and then every three months after that. PrEP prescription refills were scheduled at 1-month, 3-month, 6-month, 9-month, and 12-month clinical visits after initiation as other necessary indicators (HIV test results, risk assessment, and prescription renewal) were done at these appointments.

PrEP was indicated for specific populations at substantial risk of HIV, including MSM, serodiscordant couples (SDC) where the partner with HIV is not virally suppressed, TGW, PWID, FSW, individuals with a recent history of STIs, those who have undergone postexposure prophylaxis (PEP), individuals who recognize their own risk and request PrEP. Before initiating PrEP, clients were screened for eligibility through a standard risk assessment form testing for HIV (using antibody/antigen fourth-generation tests for as recommended by the national guidelines), creatinine, hepatitis B and C virus, syphilis, and chlamydia and gonorrhea (if available), and a clinical exam. If eligible, clients were prescribed same day PrEP drugs for one month and scheduled revisits every three months for PrEP refills, HIV testing, and/or creatinine. According to the national guidelines, clients who want to stop PrEP (e.g., when they report no longer being at risk of HIV infection or preferred another HIV prevention method) were recommended to have a consultation with their healthcare provider to retest for HIV, reassess risk, receive any counseling as needed, and recording the reason for stopping PrEP in the client medical records.

2.3 Data capture, measures, and analysis

Clinics captured individual-based data on real-time PrEP service utilization using electronic medical records (EMR) uploaded onto a secure online system of the national PrEP program (HMED PrEP). The HMED system facilitates the capture of comprehensive clinical and demographic data, such as age, sex, population group, start date for PrEP, HIV test result, PrEP regimen, prescription, and adherence at each scheduled visit, date of stopping PrEP, the reason for stopping, and referral source. Health care providers directly imported data at the clinics to ensure contemporaneous and accurate documentation of client interactions. Each clinic had an HMED account to import data on a daily or weekly basis and export data for monthly/quarterly progress indicator reports required by the government and the donor. To safeguard the quality and integrity of the data, Monitoring, Evaluation and Learning (MEL) staff at PATH, the clinics, CBOs and local health authorities employed Data Quality Audit (DQA) and Continuous Quality Improvement (CQI) procedures. The DQA process involved routine validation checks to identify and correct inconsistencies or missing data for enhancing data completeness and accuracy. Concurrently, the CQI visits to PrEP clinics were conducted to identify real-time data gaps, provide feedback, and support for improvement of data quality at the clinics. These quality control measures aimed at enhancing the reliability and validity of the dataset and ensuring robust and accurate data analysis.

The routine programmatic data on PrEP service delivery from the 40 public and private clinics was de-identified, synthesized, verified, and transferred to Stata 14 analysis. As part of routine monitoring, these PrEP clinics measured and reported core indicators required by the national PrEP program, including PrEP initiation, PrEP uptake, PrEP continuation at three months, and PrEP discontinuation including HIV seroconversion. In this study key variables were operationally defined as follows:

- PrEP initiation was defined as the number of individuals newly enrolled on oral PrEP to prevent HIV infection, reported quarterly.

- PrEP uptake was defined as the number of people who received oral PrEP at least once within the last 12 months.

- PrEP continuation was defined as receiving a PrEP drug refill at 1, 2, 3, 6, 9, and 12 months after PrEP initiation.

- PrEP discontinuation was defined as formally stopping PrEP use or having no show visit at 1,2,3,6,9, and 12 months after PrEP initiation and never returning to the clinic within 30 days.

- Time on PrEP was calculated as the number of days between starting PrEP and stopping PrEP or being lost to follow-up.

- PrEP re-initiation was identified as a visit where a participant reported currently taking PrEP after having previously indicated discontinuation.

- HIV seroconversion was defined as HIV infection detected during the follow-up visit in a participant who was HIV-seronegative at the time of enrollment.

- HIV infection was defined as positive HIV diagnosis determined by the national HIV testing algorithm, using three different rapid diagnostic tests (RDTs) or the gold standard enzyme immunoassay (EIA) or enzyme-linked immunosorbent assay (ELISA).


The main outcome of interest was PrEP persistence or continuation over time, as well as the factors associated with PrEP persistence between private and public sector PrEP service delivery models. PrEP persistence referred to the length of time that a person continued to refill PrEP prescriptions without an interruption of more than 30 days. PrEP persistence rate was defined as the proportion of participants initiating PrEP within 30 days of enrollment on PrEP at the three months, six months, nine months, or 12 months assessment regardless of any time off PrEP in the interim retention. Clinics monitored PrEP prescription refills from a person's first PrEP prescription date until there was a gap of more than 30 days between refills or a complete discontinuation of PrEP. We calculated the end date in PrEP persistence as the date the prescribed PrEP drugs would run out (daily PrEP). If the person did not refill a PrEP prescription within 30 days of the end date, we considered the person non-persistent on the 31st day. We used a 30-day gap to define non-persistence because a longer gap might result in drug levels too low to confer protection.

Descriptive analysis was applied to describe the PrEP initiation and reinitiation, PrEP uptake, PrEP discontinuation, and the reasons for discontinuation after enrollment at public and private clinics. The statistical analysis, using the Chi-square, Fisher exact test, or T-test was employed to compares the difference in outcomes by factors. To examine factors associated with PrEP persistence for at least 3 months, a mixed-effects logistic regression was applied to control for individual-level repeated measurements. The primary outcome variable was PrEP persistence for at least 3 months. Independent variables included demographic factors (age group, KP type), type of PrEP service provider, PrEP service delivery model, and use of fee-based PrEP services. A random factor at the individual level was included in the model to account for repeated measurements, along with the time variable to test for interactions. Odds ratios (OR) with 95% confidence intervals (95% CI) were reported, and a significant level of p-value of 0.05 was applied to all statistical analyses.

We used Kaplan-Meier survival analysis to calculate PrEP persistence because the enrolment of PrEP clients was rolling over time. The Kaplan-Meier approach is one of the best options to measure the fraction of subjects living for a certain amount of time after treatment (18, 19). We utilized the Kaplan-Meier time-to-event method to estimate the duration of persistence in months and calculated the percentage of PrEP persistence at different time points after PrEP initiation (i.e., 1, 3, 6, 9, 12, 18, and 24 months). The probabilities derived from each interval were used to calculate the overall likelihood of the continuation occurring at different time points. Kaplan-Meier survival curves were generated to identify the differences of PrEP persistence by type of PrEP service providers (private vs. public clinics). This study followed clients overtime at scheduled visits from PrEP initiation (M0) to 12-month visits (M12).

HIV seroconversion rate (or HIV incidence rate) among PrEP users was defined as the number of HIV infections per 100 person-years (PY) of follow up after PrEP initiation. The date of infection was estimated as the midpoint between the date of the last negative screening test and the date of the first positive one. Follow-up time was calculated from PrEP initiation to HIV infection or the earlier participant's HIV-negative screening test. Where HIV seroconversions occurred among clients taking PrEP, a case report was prepared detailing when the HIV seroconversion took place, probable cause, and ART status.

3 Results

3.1 PrEP initiation

From 01 October 2017 to 30 September 2023, 40 clinics (17 private and 23 public) initiated PrEP for a total of 29,944 clients, of which private clinics contributed four times higher initiations than public clinics (79.3% vs. 20.7%, respectively), and the difference in the number of PrEP initiations at private and public clinics on a quarterly (Q) basis was statistically different (Chi-square test, p < 0.001) (Figure 1).

Figure 1
www.frontiersin.org

Figure 1. Cumulative new PrEP users enrolled quarterly (Q) by public and private clinics, 2018–2023.

Table 1 shows characteristics of PrEP clients at public and private clinics. PrEP clients at private clinics were significantly younger than that at public clinics (median age: 25 vs. 27, respectively; p < 0.001). Overall, the vast majority of PrEP clients at either private or public clinics were at 20–49 years (95% and 94%, respectively). The proportion of clients at 15–19 years at private clinics was slightly higher than that at public clinics (3.7% vs. 2.7%, respectively), while the proportion of clients at 50 years and older at public clinics was significantly higher than that at private clinics (3.4% vs. 1.3%, respectively; p < 0.001). The proportion of male clients at private clinics was significantly higher than that at public clinics (94.7% vs. 80.4%, respectively), while the proportion of female clients at public clinics was significantly higher than that at private clinics (19.6% vs. 5.3%, respectively; p < 0.001). Similarly, the proportion of MSM clients at private clinics was significantly higher than that at public clinics (89.3% vs. 66.7%, respectively). Notably, the proportion of TGW clients at private clinics was significantly higher than that at public clinics (4% vs. 0.5%, respectively), while the proportion of SDC, PWID and FSW clients at public clinics was significantly higher than that at private clinics (21.9%, 3% and 4.3% vs. 3.7%, 0.1% and 1.8%, respectively; p < 0.001). PrEP clients at private clinics accounted for two-thirds (69.7%) of total clients in HCMC, while those only accounted for 11.5% or 18.8% in Dong Nai and Hanoi.

Table 1
www.frontiersin.org

Table 1. Characteristics of clients who started PrEP at public and private clinics.

3.2 PrEP uptake

Over six years (2018–2023), we found that the number of people who received PrEP at least once in the last 12 months was consistently higher at private clinics compared to public clinics (Figure 2). Except for 2018, the number of PrEP clients at private clinics was three to nine times higher than public clinics (ratio: 31; 5;3;3;5;9, sequentially from 2018 to 2023). This reflects the substantial contribution of private sector service providers to PrEP uptake in the three project provinces.

Figure 2
www.frontiersin.org

Figure 2. Annual PrEP uptake at private and public clinics, 2018–2023.

3.3 PrEP persistence

Overall, the median persistence of PrEP users at private clinics was significantly longer than that at public clinics (268 vs. 148 days, respectively). The Kaplan-Meier curve illustrates the persistence of individuals on PrEP by facility type (private vs. public clinics) over a period of two years (Figure 3). We found that PrEP persistence among clients at private clinics was consistently higher than that at public clinics. After two years, PrEP persistence among clients at private clinics remained higher than that at public clinics. The steep decline trend of PrEP persistence at public clinics indicated a higher rate of PrEP discontinuation among clients at public clinics compared to private clinics (see Table 3 below). The Log-rank test confirmed a significant difference of PrEP persistence between private and public clinics (p < 0.001).

Figure 3
www.frontiersin.org

Figure 3. Kaplan–Meier curve of percentage of clients using PrEP who persisted with PrEP, by PrEP facility type (private vs. public clinics), 2018–2023.

Figure 4 shows the trend of the average number of days on PrEP use among clients at private and public clinics over six years. The average number of days of PrEP use among clients at private clinics was consistently longer than that at public clinics throughout all six years though average number of days in the public sector has increased substantially since 2018 (ranging from 124 to 357 days with mean of 331 days vs. 44–237 days with mean of 204 days, respectively).

Figure 4
www.frontiersin.org

Figure 4. Average number of days on PrEP use among clients at private and public clinics, 2018–2023.

Overall, PrEP persistence rate at the three months (M3) at private clinics was consistently higher than at public clinics. Mixed-effects logistic regression analysis results indicated a significant association between PrEP persistence for at least three months and initiating PrEP at private clinics [adjusted odds ratio [aOR] = 4.28; 95% confidence interval [CI]: 2.96–6.19], opting for TelePrEP (aOR = 3.42; 95% CI: 2.12–5.53), or being a client at 20 years and older (aOR = 1.86; 95% CI: 1.62–2.13). In contrast, those who started PrEP through mobile PrEP services were less likely to be retained on PrEP for three months and longer (aOR = 0.57; 95% CI: 0.43–0.75) (Table 2).

Table 2
www.frontiersin.org

Table 2. Factors associated with PrEP persistence for at least three months.

3.4 PrEP discontinuation and reinitiation

Notably, the proportion of clients who continued PrEP for three consecutive months and longer after initiation at private clinics was significantly higher than that at public clinics (85.3% vs. 70.9%, respectively, while the proportion of clients who continued PrEP for less than three months was lower than that at public clinics (14.7% vs. 29.1%, respectively; p < 0.001) (Table 3). Similarly, the proportion of clients who discontinued PrEP at more than three months after initiation at private clinics was significantly higher than that at public clinics (86% vs. 65.4%, respectively), while the proportion of clients who discontinued PrEP at less than three months after initiation was significantly lower than that at public clinics (14% vs. 34.6%, respectively; p < 0.001). The proportion of PrEP discontinuers who restarted PrEP at private clinics was significantly higher than that at public clinics (21.7% vs. 15.9%, respectively; p < 0.001).

Table 3
www.frontiersin.org

Table 3. PrEP continuation, discontinuation and reinitiation at public and private clinics.

Reasons for discontinuation of PrEP use prior to three months after enrollment commonly reported by public and private clinics on the HMED system were lost to follow-up (LTFU), no longer at risk for HIV infection, and other personal reasons (e.g., changing living places and returning to hometown, particularly during COVID-19 in 2021), while side effects and HIV seroconversion were rarely reported (Figure 5). The reason “no longer at risk” was more likely to be reported by clients at private than at public clinics (23% vs. 15.7%, respectively). In comparison, the “other reasons” were more likely to be reported by clients in public than at private clinics (22.9% vs.16.7%, respectively).

Figure 5
www.frontiersin.org

Figure 5. Reasons for discontinuation of PrEP use before three months after initiation at private and public clinics.

Similarly, reasons for stopping PrEP use after 3 months and beyond were also LTFU, no longer at risk, and other reasons (e.g., changing living places and returning to hometown, particularly during COVID-19 in 2021). Clients at public clinics were more likely to report “no longer at risk” than at private clinics, while clients at private clinics were more likely to report “LTFU” and “other reasons” than at public clinics (28.9% vs. 19.9% and 39.1% vs. 30.9%, respectively) (Figure 6).

Figure 6
www.frontiersin.org

Figure 6. Reasons for discontinuation of PrEP use after 3+ months at private and public clinics.

3.5 HIV seroconversion

We identified 15 clients who HIV seroconversion among 31,887 daily oral PrEP users over six years. Overall, HIV seroconversion among PrEP users at both public and private clinics was extremely low (0.047 per 100 person-years-PY) (Figure 7). In other words, 95% of PrEP users would be protected from HIV infection during the time they were on PrEP use. Notably, the HIV seroconversion rate was significantly lower among PrEP users at private clinics compared to public clinics (0.03% vs. 0.13%, respectively; p < 0.01). This seroconversion rate was consistently lower at private clinics compared to public clinics after PrEP initiation at more than one month (0.02% vs. 0.094 per 100 PY, respectively; p < 0.05). There was no significant difference in seroconversion rate at the month one (M1) after initiation between private and public clinics.

Figure 7
www.frontiersin.org

Figure 7. Observed HIV incidence rate among PrEP users at private and public clinics, 2018–2023. Fisher's exact test; *p < 0.05; **p < 0.01.

4 Discussion

Private sector engagement in global health is a paradigm shift in the approach to development for greater impact and scale. PSE can result in greater scale, higher efficiency, accelerating innovation, creation of new markets, and enhanced sustainability of global health programs (20). Vietnam introduced the PSE approach in HIV response in 2014 in the context 80% of the national HIV programs were funded by external donors, and major donors had left or dramatically reduced the size and geographic scope of programs. USAID/PATH Healthy Markets (2014–2021) and USAID/PATH STEPS (2021–2026) were key partners of the Ministry of Health in implementing and scaling up PSE in new and innovative interventions, including PrEP. Although PSE in PrEP service delivery has been implemented across provinces and cities, supported by PEPFAR and GF, there was no published comprehensive analyses to demonstrate the effectiveness of the approach as part of a range of service options and its role in facilitating scale up of PrEP to achieve the HIV epidemic control in LMICs like Vietnam.

Our study assessed the effectiveness of engaging private sector health facilities in PrEP service delivery over six years in the national PrEP implementation program in Vietnam. We found that private sector PrEP service delivery played a critical role in scaling up PrEP services in the country. The private sector health facilities proved the ability to initiate PrEP uptake for a substantial number of people in need, successfully retain people on PrEP, and as a result, increase coverage of HIV prevention in Vietnam.

PrEP is a revolutionary HIV prevention tool, but high PrEP coverage must be achieved to have an impact on reductions in new HIV infection at the population level (1). PrEP uptake is a critical part of the PrEP cascade and is a key indicator to measure PrEP coverage (2123). Given achieving the global PrEP targets by 2025 is far from being on track, the WHO strongly recommended the implementation of differentiated and simplified PrEP service delivery models to accelerate the attainment of the global targets (24). We found that the private sector PrEP service delivery model was successful in initiating PrEP for those in need. We posit that the reasons for success of private clinics in initiating and restarting PrEP may include offering client-centered care tailored to the needs of those that can benefit from PrEP, including MSM and TGW, greater perceived convenience, and providing more choice of PrEP service delivery options, such as on-site, mobile, or TelePrEP. In addition, PrEP services at private sector health facilities, particularly KP-led clinics are perceived as friendly, convenient, one-stop shopping experiences with flexible working hours. These advantages may make private clinics more attractive to MSM and TGW. In contrast, public clinics were able to recruit more serodiscordant couples, FSW, and PWID who are sexual partners of ART patients. Notably, KP-led private clinics that are KP-friendly and offer gender-affirming care counseling and testing were able to reach TGW, who are the most at-risk population, but hard to reach due to stigma and discrimination related to gender identity. This suggests that both public and private sector services are needed, and that private sector PrEP service delivery models plays a significant role in expanding PrEP coverage to key populations that are most in need of PrEP.

There has been concern over the persistence of PrEP use to ensure PrEP is highly effective in preventing HIV acquisition in any PrEP service delivery model. Good adherence to daily oral PrEP is associated with high prevention effectiveness, with at least four doses per week providing more than 90% efficacy for MSM, and poor adherence was associated with markedly reduced efficacy of PrEP (2528). WHO guidelines suggest that PrEP can be stopped when persons are no longer at risk for HIV, and recommended client and provider decision-making regarding appropriate PrEP discontinuation (29). However, there are multiple patient-driven reasons for discontinuation, such as personal choice and preference, changes in life situation, and risk perceptions. We found an exceptionally high PrEP persistence among PrEP users at private sector PrEP service delivery sites compared to that at public sector PrEP sites. This finding is compatible with a study among young Thai men and transgender women that reported higher PrEP persistence (91.1%) at month 3 (30) but contrasts with studies among female sex workers (31) and adolescent girls and young women (32) in Africa that reported lower persistence at month 3 (33% and 34.9%). High PrEP persistence at the private clinics in this study may be related to the community engagement approach. MSM and TGW worked as service providers in diverse roles, such as clinicians, counselors, lab technicians, and pharmacists in KP-led private or non-KP-led private clinics. Private clinics also formed a strong partnership with community-based organizations (CBO) working as HIV case-finding partners, funded by PEPFAR and GF that supported PrEP referral, adherence counseling, and follow-up. In addition, private clinics maintained a reminder system via telephone calls or messages to clients before each scheduled visit and offered on-site testing and PrEP refills outside working hours. This indirectly reflects the quality of PrEP services provided by private service providers.

HIV seroconversion among PrEP users is a critical concern, as the goal of PrEP implementation is to prevent HIV acquisition at the individual level and drive HIV transmission toward elimination at the population level. Previous studies revealed a low rate of new HIV infections among people who took daily PrEP or lower HIV incidence among PrEP initiators compared to matched controls (30, 33, 34). These studies also observed that HIV seroconversions were mostly seen in those who stopped taking their pills. A multi-country demonstration study from West Africa showed that HIV seroconversions were higher for event-driven PrEP than daily PrEP (35), and it was significantly associated with persons who stopped PrEP. In general, we found a low HIV seroconversion rate among PrEP clients in our study, and the seroconversion rate was significantly lower among clients who opted for private sector PrEP service delivery compared to those who opted for public sector PrEP service delivery. This can be explained by the exceptionally high persistence rate among PrEP users at private clinics reported in the results section. In addition, private clinics maintained community peer counselors to support treatment adherence counseling to PrEP clients, using varied channels, such as telephone hotline, messaging via Zalo or Facebook, and face-to-face interactions during community outreach activities to remind clients prior to each scheduled visit and throughout their PrEP use course.

Limitations: Although the study's strength lies in its large sample size of PrEP clients and use of electronic medical records (EMR) from multiple sites in different geographic settings, the study has several limitations. First, the data is not representative of the national PrEP program. Second, the challenges inherent in collecting programmatic data within routine service delivery settings may occur missing or incomplete data. We proactively reviewed monthly progress indicator reports submitted by clinics and conducted routine DQA and CQI activities to improve the quality of data. Given the nature of retrospective programmatic data with basic indicators required by the national PrEP program, the ability to perform comprehensive data analysis to answer the research questions is limited, and the interpretation of results may be bias due to missing data or potential confounding factors. The retrospective study hinders the rigorous design to allow the comparison between public and private sector PrEP service delivery properly.

5 Conclusions

Engaging private sector service providers, such as private and KP-led clinics in PrEP service delivery is an effective approach to implement and scale-up PrEP in LMICs like Vietnam. Private sector service providers play a pivotal role in increasing PrEP uptake and expanding PrEP coverage. This study contributes to empirical evidence on the effectiveness of private sector engagement in PrEP service delivery that will reinforce ongoing efforts of the country to accelerate scaling up PrEP to achieve the ending AIDS goal by 2030. In line with this approach, the Ministry of Health approved the five-year national action plan on private sector engagement and investment in HIV response for the period 2021–2025, which is an excellent opportunity to increase scope and scale of private sector engagement in PrEP program throughout the country. This also includes engaging private pharmacies in PrEP service delivery to increase PrEP coverage and use, especially among populations not reached by clinic-based services. More research and programmatic evidence are needed to understand how best to implement and finance private sector engagement models to maximize impact particularly with the introduction of long-acting injectable PrEP products, such as cabotegravir and lenacapavir in LMIC settings.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.

Ethics statements

The studies involving humans were approved by PATH Office of Research Affairs - Research Determination Committee. The studies were conducted in accordance with the local legislation and institutional requirements. The Ethics Committee/institutional review board waived the requirement of written informed consent for participation from the participants or the participants' legal guardians/next of kin because The Research Determination Committee (RDC) reviewed and determined this activity is Not Research.

Author contributions

BV: Conceptualization, Formal Analysis, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. KG: Conceptualization, Funding acquisition, Project administration, Writing – review & editing. HP: Conceptualization, Funding acquisition, Project administration, Resources, Writing – review & editing. LT: Data curation, Formal Analysis, Investigation, Validation, Visualization, Writing – review & editing. PP: Investigation, Project administration, Resources, Supervision, Writing – review & editing. TT: Funding acquisition, Project administration, Resources, Supervision, Writing – review & editing. LD: Data curation, Project administration, Resources, Supervision, Writing – review & editing. YV: Conceptualization, Project administration, Resources, Supervision, Writing – review & editing. CP: Data curation, Formal Analysis, Resources, Software, Supervision, Writing – review & editing. DN: Conceptualization, Funding acquisition, Project administration, Supervision, Writing – review & editing. AD: Conceptualization, Funding acquisition, Project administration, Supervision, Writing – review & editing. TN: Conceptualization, Funding acquisition, Project administration, Supervision, Writing – review & editing. PT: Investigation, Project administration, Resources, Supervision, Writing – review & editing. VN: Investigation, Project administration, Resources, Supervision, Writing – review & editing. BN: Investigation, Project administration, Resources, Supervision, Writing – review & editing. TP: Investigation, Project administration, Resources, Supervision, Writing – review & editing. HN: Investigation, Project administration, Resources, Supervision, Writing – review & editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. Funding support was received from the President's Emergency Plan for AIDS Relief (PEPFAR) through the United States Agency for International Development (USAID) through the USAID/PATH Healthy Markets and USAID/PATH Support for Technical Excellence and Private Sector Sustainability in Vietnam (STEPS) projects. The findings, conclusions, and recommendation within this paper are those of the authors, and do not necessarily stand for the official position of the USAID, PEPFAR, or the U.S. Government.

Acknowledgments

We acknowledge the dedication, leadership, and collaboration of the Vietnam Administration of HIV/AIDS Control (VAAC), Ministry of Health. We would like to thank the Provincial Health Department and Center for Disease Control (CDC), district health centers, social enterprises and community-based organizations in Hanoi, Ho Chi Minh City, and Dong Nai for their partnership to implement and scale-up of PrEP services over six years. We thank the healthcare workers and program staff who made PrEP service delivery available and accessible to people in need. Special thanks to public and private clinics for their dedication in providing PrEP services.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

1 Ministry of Health. National PrEP Scale-up Plan for the Period 2021–2025 (Vietnamese Version). Hanoi (2020).

2 Ministry of Health. National Guidelines on HIV/AIDS Care and Treatment. Hanoi (2019).

References

1. Bavinton BR, Grulich AE. HIV pre-exposure prophylaxis: scaling up for impact now and in the future. Lancet Public Health. (2021) 6:e528–32. doi: 10.1016/S2468-2667(21)00112-2

PubMed Abstract | Crossref Full Text | Google Scholar

2. AVAC. Global PrEP Tracker, fourth quarter 2023 (2023). Available online at: https://www.prepwatch.org/resources/global-prep-tracker/ (Accessed April 30, 2024).

Google Scholar

3. UNAIDS. The Urgency of now: AIDS at a Crossroad: 2024 Global AIDS Update4. Geneva: Joint United Nations Programme on HIV/AIDS (2024). https://www.unaids.org/sites/default/files/media_asset/2024-unaids-global-aids-update_en.pdf (Accessed October 25, 2024).

Google Scholar

4. Green KE, Long NH, Huong PTT, Bao VN, Minh TH, Huu NV, et al. Prepped for PrEP? Acceptability, continuation, and adherence among men who have sex with men and transgender women enrolled as part of Vietnam’s first pre-exposure prophylaxis program. Sex Health. (2021) 18(18):104–15. doi: 10.1071/SH20167

PubMed Abstract | Crossref Full Text | Google Scholar

5. USAID. Engaging the private sector to combat HIV and AIDS (2021). Available online at: https://2017-2020.usaid.gov/global-health/health-areas/hiv-and-aids/technical-areas/engaging-private-sector-combat-hiv-and-aids (Accessed April 30, 2024).

Google Scholar

6. Ezechi OC, Oladele DA, Dureke F, Anenih J, Ogungbemi K, Folayan MO. Private health sector engagement in the national HIV response in Nigeria: findings from a nationally representative sample of stakeholders. Niger J Health Sci. (2014) 14:23–8.

Google Scholar

7. World Health Organization. Global Health Sector Strategies on, Respectively, HIV, Viral Hepatitis, and Sexually Transmitted Infections for the Period 2022–2030. Geneva: World Health Organization (2022). https://iris.who.int/bitstream/handle/10665/360348/9789240053779-eng.pdf?sequence=1 (Accessed August 14, 2024).

Google Scholar

8. PEPFAR. PEPFAR 2023 Country and Regional Operational Plan (COP/ROP) Guidance for all PEPFAR-Supported Countries (2023). Available online at: https://www.state.gov/wp-content/uploads/2023/02/PEPFAR-2023-Country-and-Regional-Operational-Plan.pdf (Accessed April 30, 2024).

Google Scholar

9. The Global Fund. Technical Brief Private Sector Engagement in Service Delivery Allocation Period 2023–2025 (2023). Available online at: https://www.theglobalfund.org/media/12160/ps_private-sector-engagement-technical_brief_en.pdf (Accessed April 30, 2024).

Google Scholar

10. Roche SD, Were D, Crawford ND, Tembo A, Pintye J, Bukusi E, et al. Getting HIV Pre-exposure prophylaxis (PrEP) into private pharmacies: global delivery models and research directions. Curr HIV/AIDS Rep. (2024) 21:116–30. doi: 10.1007/s11904-024-00696-y

PubMed Abstract | Crossref Full Text | Google Scholar

11. World Health Organization. Engaging the Private Health Service Delivery Sector Through Governance in Mixed Health Systems: Strategy Report of the wHO Advisory Group on the Governance of the Private Sector for Universal Health Coverage. Geneva: World Health Organization (2020). https://iris.who.int/bitstream/handle/10665/341057/9789240018327-eng.pdf?sequence=2 (Accessed September 10, 2024).

Google Scholar

12. Rao P, Gabre-Kidan T, Mubangizi DB, Sulzbach S. Leveraging the private health sector to enhance HIV service delivery in lower-income countries. J Acquir Immune Defic Syndr. (2011) 57:S116–119. doi: 10.1097/QAI.0b013e31821ed719

PubMed Abstract | Crossref Full Text | Google Scholar

13. Vietnam National Assembly. Law on Revision and Amendment of Sone Articles on HIV/AIDS Prevention and Control (Vietnamese Version). Hanoi: Vietnam Law Library (2020).

Google Scholar

14. Government of Vietnam. National Strategy for Ending AIDS by 2030 (Vietnamese Version). Hanoi: Vietnam Legal Normative Documents (2020).

Google Scholar

15. Nguyen Minh. Vietnam—exceptional example of fighting against HIV/AIDS: PEPFAR. Hanoi Times (2023). https://hanoitimes.vn/vietnam-exceptional-example-of-fighting-against-hivaids-pepfar-323664.html (Accessed April 30, 2024).

Google Scholar

16. Green KE. Differentiated PrEP delivery—from pilots to pushing towards the global PrEP targets. In: Kamarulzaman A, Streeck H, editors. Pivoting HIV Prevention During a Parallel Pandemic. 11 IAS Conference on HIV Science. Berlin. (2021). p. 51. Available online at: https://ias2021.org/wp-content/uploads/2022/01/IAS2021_Conference-Report.pdf

Google Scholar

17. Hendrickson C, Long L, Vijver DVD, Boucher C, O’Bra H, Claassen CW, et al. Novel metric for evaluating pre-exposure prophylaxis program effectiveness in real-world settings. Lancet HIV. (2020) 7(4):e294–300. doi: 10.1016/S2352-3018(19)30344-3

PubMed Abstract | Crossref Full Text | Google Scholar

18. Goel MK, Khanna P, Kishore J. Understanding survival analysis: kaplan-meier estimate. Int J Ayurveda Res. (2010) 1(4):274–8. doi: 10.4103/0974-7788.76794

PubMed Abstract | Crossref Full Text | Google Scholar

19. Huang Y-LA, Tao G, Smith DK, Hoover KW. Persistence with human immunodeficiency virus Pre-exposure prophylaxis in the United States, 2012–2017. Clin Infect Dis. (2021) 72(3):379–85. doi: 10.1093/cid/ciaa037

PubMed Abstract | Crossref Full Text | Google Scholar

20. United States Agency for International Development. Private sector engagement. Global Health News. (2018). Available online at: https://www.usaid.gov/global-health/global-health-newsletter/private-sector-partnerships (Accessed April 30, 2024).

Google Scholar

21. World Health Organization. WHO implementation Tool for pre-exposure prophylaxis (PrEP) of HIV Infection. Module 5: Monitoring and Evaluation. Geneva: World Health Organization (2018) (WHO/CDS/HIV/18.10). https://iris.who.int/bitstream/handle/10665/279834/WHO-CDS-HIV-18.10-eng.pdf (Accessed April 30, 2024).

Google Scholar

22. Baggaley R, Dalal S, Johnson C, Macdonald V, Mameletzis I, Rodolph M, et al. Beyond the 90–90–90: refocusing HIV prevention as part of the global HIV response. J Int AIDS Soc. (2016) 19:21348. doi: 10.7448/IAS.19.1.21348

PubMed Abstract | Crossref Full Text | Google Scholar

23. Krishnaratne S, Hensen B, Cordes J, Enstone J, Hargreaves JR. Interventions to strengthen the HIV prevention cascade: a systematic review of reviews. Lancet HIV. (2016) 3(7):e307–17. doi: 10.1016/S2352-3018(16)30038-8

PubMed Abstract | Crossref Full Text | Google Scholar

24. World Health Organization. Differentiated and Simplified pre-exposure prophylaxis for HIV Prevention: Update to WHO Implementation Guidance. Technical Brief. Geneva: World Health Organization (2022). https://www.who.int/publications/i/item/9789240053694 (Accessed April 30, 2024).

Google Scholar

25. Kiggundu R, Soh QR, Tieosapjaroen W, Fairley C, Zhang L, Tucker JD, et al. Restarting Pre-exposure prophylaxis (PrEP) for HIV: a systematic review and meta-analysis. SSRN. (2023) 72:1–12. Available online at: https://ssrn.com/abstract=4663347 or doi: 10.2139/ssrn.4663347

Crossref Full Text | Google Scholar

26. US Preventive Services Task Force. Preexposure prophylaxis for the prevention of HIV infection. US preventive services task force recommendation statement. JAMA. (2019) 321:2203–13. doi: 10.1001/jama.2019.6390

PubMed Abstract | Crossref Full Text | Google Scholar

27. Grant RM, Lama JR, Anderson PL, McMahan V, Liu AY, Vargas L, et al. Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N Engl J Med. (2010) 363:2587–99. doi: 10.1056/NEJMoa1011205

PubMed Abstract | Crossref Full Text | Google Scholar

28. Jourdain H, de Gage SB, Desplas D, Dray-Spira R. Real-world effectiveness of pre-exposure prophylaxis in men at high risk of HIV infection in France: a nested case-control study. Lancet Public Health. (2022) 7:e529–36. doi: 10.1016/S2468-2667(22)00106-2

PubMed Abstract | Crossref Full Text | Google Scholar

29. Rutstein SE, Smith DK, Dalal S, Baggaley RC, Cohen MS. The initiation, discontinuation and Re-starting of HIV preexposure prophylaxis (PrEP): an ongoing evolution of implementation strategies. Lancet HIV. (2020) 7(10):e721–730. doi: 10.1016/S2352-3018(20)30203-4

PubMed Abstract | Crossref Full Text | Google Scholar

30. Weir BW, Wirtz AL, Chemnasiri T, Baral SD, Decker M, Dun C. High PrEP uptake, adherence, persistence and effectiveness outcomes among young Thai men and transgender women who sell sex in Bangkok and pattaya, Thailand: findings from the open-label combination HIV prevention effectiveness (COPE) study. Lancet Regional Health—Southeast Asia. (2023) 15:100217. doi: 10.1016/j.lansea.2023.100217

PubMed Abstract | Crossref Full Text | Google Scholar

31. Barnabee G, O’Bryan G, Ndeikemona L, Billah I, Silas L, Morgan KL, et al. Improving HIV pre-exposure prophylaxis persistence among adolescent girls and young women: insights from a mixed-methods evaluation of community, hybrid, and facility service delivery models in Namibia. Front Reprod Health. (2022) 4:1048702. doi: 10.3389/frph.2022.1048702

PubMed Abstract | Crossref Full Text | Google Scholar

32. Rao A, Mhlophe H, Comins C, Young K, Mcingana M, Lesko C, et al. Persistence on oral pre-exposure prophylaxis (PrEP) among female sex workers in eThekwini, South Africa, 2016–2020. PLoS One. (2022) 17(3):e0265434. doi: 10.1371/journal.pone.0265434

PubMed Abstract | Crossref Full Text | Google Scholar

33. Highleyman L. HIV seroconversion is rare if Truvada PrEP is used consistently. aidsmap (2016). Available online at: https://www.aidsmap.com/news/jul-2016/hiv-seroconversion-rare-if-truvada-prep-used-consistently (Accessed April 30, 2024).

Google Scholar

34. Koss CA, Havlir DV, Ayieko J, Kwarisiima D, Kabami J, Chamie G, et al. HIV Incidence after pre-exposure prophylaxis initiation among women and men at elevated HIV risk: a population-based study in rural Kenya and Uganda. PLoS Med. (2021) 18(2):e1003492. doi: 10.1371/journal.pmed.1003492

PubMed Abstract | Crossref Full Text | Google Scholar

35. Laurent C, Yaya I, Cuer B, Sagaon-Teyssier L, Mensah E, Dah TTE, et al. Human immunodeficiency virus seroconversion among men who have sex with men who use event-driven or daily oral Pre-exposure prophylaxis (CohMSM-PrEP): a multi-country demonstration study from West Africa. Clin Infect Dis. (2023) 77(4):606–14. doi: 10.1093/cid/ciad221

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: HIV prevention, pre-exposure prophylaxis, private sector engagement, key populations, Vietnam

Citation: Vu BN, Green K, Phan H, Tran L, Phan P, Tran T, Doan L, Vu Y, Pham C, Nguyen D, Doan A, Ngo T, Tran P, Nguyen V, Nguyen B, Phan T and Nguyen H (2025) Engaging the private sector as part of HIV pre-exposure prophylaxis service delivery in Vietnam: a comparative analysis of uptake, persistence and HIV seroconversion from 2018 to 2023. Front. Reprod. Health 6:1439461. doi: 10.3389/frph.2024.1439461

Received: 28 May 2024; Accepted: 27 September 2024;
Published: 21 January 2025.

Edited by:

Timothy Mastro, University of North Carolina System, United States

Reviewed by:

Kristine Torjesen, Family Health International 360, United States
Delivette Castor, Columbia University, United States

Copyright: © 2025 Vu, Green, Phan, Tran, Phan, Tran, Doan, Vu, Pham, Nguyen, Doan, Ngo, Tran, Nguyen, Nguyen, Phan and Nguyen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Bao Ngoc Vu, YnZ1QHBhdGgub3Jn

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.