Topic modeling for segment-based documents

Giovanni Ponti, Andrea Tagarelli, George Karypis

Research output: Contribution to conferencePaper

Abstract

Statistical topic models have traditionally assumed that a document is an indivisible unit for the generative process, which may not be appropriate to handle documents that are relatively long and show an explicit multi-topic structure. In this paper we describe a generative model that exploits a given decomposition of documents in smaller, topically cohesive text units, or segments. The key-idea is to introduce a new variable in the generative process to model the document segments in order to relate the word generation not only to the topics but also to the segments. Moreover, the topic latent variable is directly associated to the segments, rather than to the document as a whole. Experimental results have shown the significance of the proposed model and its better support for the document clustering task compared to other existing generative models. Copyright (c) 2012 - Edizioni Libreria Progetto and the authors.
Original languageEnglish
Publication statusPublished - 2012
Event20th Italian Symposium on Advanced Database Systems, SEBD 2012 - , Italy
Duration: 1 Jan 2012 → …

Conference

Conference20th Italian Symposium on Advanced Database Systems, SEBD 2012
CountryItaly
Period1/1/12 → …

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Information Systems

Cite this

Ponti, G., Tagarelli, A., & Karypis, G. (2012). Topic modeling for segment-based documents. Paper presented at 20th Italian Symposium on Advanced Database Systems, SEBD 2012, Italy.