This study ventures into the field of psychiatry by investigating the interactive dynamics between psychiatrists and their patients. The primary goal is to create an automated scoring mechanism using prompt engineering techniques applied to Large Language Models (LLMs) to assess the severity of depressive symptoms from these dialogues. In particular, the process of generating a depression severity score against MADRS, a rating scale widely used in psychiatry, is automated. This work aims to highlight the potential of using these techniques to improve traditional diagnostic approaches in psychiatry. The results that have emerged, while not optimal, are promising, including for the purpose of developing a full-fledged system in the future to enable the introduction of more targeted and timely interventions, thereby improving patient outcomes and improving the overall level of mental health.

Raganato, A., Bartoli, F., Crocamo, C., Cavaleri, D., Carra, G., Pasi, G., et al. (2024). Leveraging Prompt Engineering and Large Language Models for Automating MADRS Score Computation for Depression Severity Assessment. In Proceedings of the Ital-IA Intelligenza Artificiale - Thematic Workshops co-located with the 4th CINI National Lab AIIS Conference on Artificial Intelligence (Ital-IA 2024) (pp.342-347). CEUR-WS.

Leveraging Prompt Engineering and Large Language Models for Automating MADRS Score Computation for Depression Severity Assessment

Raganato A.;Bartoli F.;Crocamo C.;Cavaleri D.;Carra G.;Pasi G.;Viviani M.
2024

Abstract

This study ventures into the field of psychiatry by investigating the interactive dynamics between psychiatrists and their patients. The primary goal is to create an automated scoring mechanism using prompt engineering techniques applied to Large Language Models (LLMs) to assess the severity of depressive symptoms from these dialogues. In particular, the process of generating a depression severity score against MADRS, a rating scale widely used in psychiatry, is automated. This work aims to highlight the potential of using these techniques to improve traditional diagnostic approaches in psychiatry. The results that have emerged, while not optimal, are promising, including for the purpose of developing a full-fledged system in the future to enable the introduction of more targeted and timely interventions, thereby improving patient outcomes and improving the overall level of mental health.
paper
Large Language Models; MADRS; Mental Health; Natural Language Processing; Prompt Engineering;
English
Ital-IA Intelligenza Artificiale - Thematic Workshops co-located with the 4th CINI National Lab AIIS Conference on Artificial Intelligence (Ital-IA 2024) May 29-30, 2024
2024
Proceedings of the Ital-IA Intelligenza Artificiale - Thematic Workshops co-located with the 4th CINI National Lab AIIS Conference on Artificial Intelligence (Ital-IA 2024)
2024
3762
342
347
https://ceur-ws.org/Vol-3762/
open
Raganato, A., Bartoli, F., Crocamo, C., Cavaleri, D., Carra, G., Pasi, G., et al. (2024). Leveraging Prompt Engineering and Large Language Models for Automating MADRS Score Computation for Depression Severity Assessment. In Proceedings of the Ital-IA Intelligenza Artificiale - Thematic Workshops co-located with the 4th CINI National Lab AIIS Conference on Artificial Intelligence (Ital-IA 2024) (pp.342-347). CEUR-WS.
File in questo prodotto:
File Dimensione Formato  
Raganato-2024-Ital-IA-VoR.pdf

accesso aperto

Descrizione: This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 365.01 kB
Formato Adobe PDF
365.01 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/519760
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
Social impact