As a result of the widespread use of intelligent assistants, personalization in dialogue systems has become a hot topic in both research and industry. Typically, training such systems is computationally expensive, especially when using recent large language models. To address this challenge, we develop an approach to personalize dialogue systems using adapter layers and topic modelling. Our implementation enables the model to incorporate user-specific information, achieving promising results by training only a small fraction of parameters.
Braga, M., Raganato, A., Pasi, G. (2023). Personalization in BERT with Adapter Modules and Topic Modelling. In Proceedings of the 13th Italian Information Retrieval Workshop (IIR 2023) (pp.24-29). CEUR-WS.
Personalization in BERT with Adapter Modules and Topic Modelling
Braga M.
;Raganato A.;Pasi G.
2023
Abstract
As a result of the widespread use of intelligent assistants, personalization in dialogue systems has become a hot topic in both research and industry. Typically, training such systems is computationally expensive, especially when using recent large language models. To address this challenge, we develop an approach to personalize dialogue systems using adapter layers and topic modelling. Our implementation enables the model to incorporate user-specific information, achieving promising results by training only a small fraction of parameters.
| File | Dimensione | Formato | |
|---|---|---|---|
|
Braga-2023-CEUR Workshop Proceedings-VoR.pdf
accesso aperto
Descrizione: CC BY 4.0 This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).
Tipologia di allegato:
Publisher’s Version (Version of Record, VoR)
Licenza:
Creative Commons
Dimensione
986.63 kB
Formato
Adobe PDF
|
986.63 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
