This paper discusses the challenges of using Large Language Models (LLMs) in medical chatbots for chronic disease self-management. Accordingly, we define an architecture specifically devised to deal with issues related to reliability, clinical trials, and privacy. Two solutions are compared to prevent data disclosure: a filtering mechanism for sensitive data with an external LLM, and a locally deployed LLM using open-source models. Experimental results underscore the challenges in effectively instructing the local LLM so as to provide performances comparable to GPT-3.5.

LLM-based Solutions for Healthcare Chatbots: a Comparative Analysis

Montagna, Sara
;
Ferretti, Stefano;Klopfenstein, Lorenz Cuno;
2024

Abstract

This paper discusses the challenges of using Large Language Models (LLMs) in medical chatbots for chronic disease self-management. Accordingly, we define an architecture specifically devised to deal with issues related to reliability, clinical trials, and privacy. Two solutions are compared to prevent data disclosure: a filtering mechanism for sensitive data with an external LLM, and a locally deployed LLM using open-source models. Experimental results underscore the challenges in effectively instructing the local LLM so as to provide performances comparable to GPT-3.5.
2024
979-8-3503-0436-7
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11576/2736272
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact