Towards Interpreting Topic Models with ChatGPT

Emil Rijcken, Floortje Scheepers, Kalliopi Zervanou, Marco Spruit, Pablo Mosteiro, Uzay Kaymak

Research output: Contribution to conferencePaperAcademic

1951 Downloads (Pure)

Abstract

Topic modeling has become a popular approach to identify semantic structures in text corpora. Despite its wide applications, interpreting the outputs of topic models remains challenging. This paper presents an initial study regarding a new approach to better understand this output, leveraging the large language model ChatGPT. Our approach is built on a three-stage process where we first use topic modeling to identify the main topics in the corpus. Then, we ask a domain expert to assign themes to these topics and prompt ChatGPT to generate human-readable summaries of the topics. Lastly, we compare the human- and machine-produced interpretations. The domain expert found half of ChatGPT’s descriptions useful. This explorative work demonstrates ChatGPT’s capability to describe topics accurately and provide useful insights if prompted accurately.
Original languageEnglish
Number of pages7
Publication statusPublished - 2023
EventThe 20th World Congress of the International Fuzzy Systems Association - Daegu, Korea, Republic of
Duration: 20 Aug 202324 Aug 2023
Conference number: 20
https://ifsa2023.org/

Conference

ConferenceThe 20th World Congress of the International Fuzzy Systems Association
Abbreviated titleIFSA
Country/TerritoryKorea, Republic of
CityDaegu
Period20/08/2324/08/23
Internet address

Keywords

  • Topic Modeling
  • Large Language Models
  • ChatGPT
  • Electronic Health Records
  • Fuzzy Topic Models
  • Prompt Engineering

Fingerprint

Dive into the research topics of 'Towards Interpreting Topic Models with ChatGPT'. Together they form a unique fingerprint.

Cite this