Enhancing patient-centered information on implant dentistry through prompt engineering: A comparison of four large language models

John Tay ^1,2* Dian Yi Chow ² Ivan Lim ³ Ethan Ng ^2,4

• ¹ Duke-NUS Medical School, Singapore, Singapore
• ² National Dental Centre of Singapore, Singapore, Singapore
• ³ Royce Dental Group, Singapore, Singapore
• ⁴ Centre for Oral Clinical Research, Institute of Dentistry, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, England, United Kingdom

Background: Patients frequently seek dental information online, and generative pre-trained transformers (GPTs) may be a valuable resource. However, the quality of responses based on varying prompt designs has not been evaluated. As dental implant treatment is widely performed, this study aimed to investigate the influence of prompt design on GPT performance in answering commonly asked questions related to dental implants.Thirty commonly asked questions about implant dentistry -covering patient selection, associated risks, peri-implant disease symptoms, treatment for missing teeth, prevention, and prognosis -were posed to four different GPT models with different prompt designs. Responses were recorded and independently appraised by two periodontists across six quality domains.Results: All models performed well, with responses classified as good quality. The contextualized model performed worse on treatment-related questions (21.5±3.4, p<0.05), but outperformed the inputoutput, zero-shot chain of thought, and instruction-tuned models in citing appropriate sources in its responses (4.1±1.0, p<0.001). However, responses had less clarity and relevance compared to the other models.GPTs can provide accurate, complete, and useful information for questions related to dental implants. While prompt designs can enhance response quality, further refinement is necessary to optimize its performance.