Advanced

Knowledge discovery in virtual community texts: Clustering virtual communities

Oudshoff, AM; Bosloper, IE; Klos, TB and Spaanenburg, Lambert LU (2003) In Journal of Intelligent & Fuzzy Systems 14(1). p.13-24
Abstract
Automatic knowledge discovery from texts (KDT) is proving to be a promising method for businesses today to deal with the overload of textual information. In this paper, we first explore the possibilities for KDT to enhance communication in virtual communities, and then we present a practical case study with real-life Internet data. The problem in the case study is to manage the very successful virtual communities known as 'clubs' of the largest Dutch Internet Service Provider. It is possible for anyone to start a club about any subject, resulting in over 10,000 active clubs today. At the beginning, the founder assigns the club to a predefined category. This often results in illogical or inconsistent placements, which means that interesting... (More)
Automatic knowledge discovery from texts (KDT) is proving to be a promising method for businesses today to deal with the overload of textual information. In this paper, we first explore the possibilities for KDT to enhance communication in virtual communities, and then we present a practical case study with real-life Internet data. The problem in the case study is to manage the very successful virtual communities known as 'clubs' of the largest Dutch Internet Service Provider. It is possible for anyone to start a club about any subject, resulting in over 10,000 active clubs today. At the beginning, the founder assigns the club to a predefined category. This often results in illogical or inconsistent placements, which means that interesting clubs may be hard to locate for potential new members. The ISP therefore is looking for an automated way to categorize clubs in a logical and consistent manner. The method used is the so-called bag-of-words approach, previously applied mostly to scientific texts and structured documents. Each club is described by a vector of word occurrences of all communications within that club. Latent Semantic Indexing (LSI) is applied to reduce the dimensionality problem prior to clustering. Clustering is done by the Within Groups Clustering method using a cosine distance measure appropriate for texts. The results show that KDT and the LSI method can successfully be applied for clustering the very volatile and unstructured textual communication on the Internet. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
semantic indexing, latent, virtual community, knowledge discovery in text, clustering, web portal
in
Journal of Intelligent & Fuzzy Systems
volume
14
issue
1
pages
13 - 24
publisher
IOS Press
external identifiers
  • wos:000187011100003
  • scopus:0242468047
ISSN
1064-1246
language
English
LU publication?
yes
id
795c3951-58bc-4280-ba30-557ac760b67d (old id 293798)
alternative location
http://iospress.metapress.com/openurl.asp?genre=article&issn=1064-1246&volume=14&issue=1&spage=13
date added to LUP
2007-09-20 08:08:55
date last changed
2018-05-29 10:47:51
@article{795c3951-58bc-4280-ba30-557ac760b67d,
  abstract     = {Automatic knowledge discovery from texts (KDT) is proving to be a promising method for businesses today to deal with the overload of textual information. In this paper, we first explore the possibilities for KDT to enhance communication in virtual communities, and then we present a practical case study with real-life Internet data. The problem in the case study is to manage the very successful virtual communities known as 'clubs' of the largest Dutch Internet Service Provider. It is possible for anyone to start a club about any subject, resulting in over 10,000 active clubs today. At the beginning, the founder assigns the club to a predefined category. This often results in illogical or inconsistent placements, which means that interesting clubs may be hard to locate for potential new members. The ISP therefore is looking for an automated way to categorize clubs in a logical and consistent manner. The method used is the so-called bag-of-words approach, previously applied mostly to scientific texts and structured documents. Each club is described by a vector of word occurrences of all communications within that club. Latent Semantic Indexing (LSI) is applied to reduce the dimensionality problem prior to clustering. Clustering is done by the Within Groups Clustering method using a cosine distance measure appropriate for texts. The results show that KDT and the LSI method can successfully be applied for clustering the very volatile and unstructured textual communication on the Internet.},
  author       = {Oudshoff, AM and Bosloper, IE and Klos, TB and Spaanenburg, Lambert},
  issn         = {1064-1246},
  keyword      = {semantic indexing,latent,virtual community,knowledge discovery in text,clustering,web portal},
  language     = {eng},
  number       = {1},
  pages        = {13--24},
  publisher    = {IOS Press},
  series       = {Journal of Intelligent & Fuzzy Systems},
  title        = {Knowledge discovery in virtual community texts: Clustering virtual communities},
  volume       = {14},
  year         = {2003},
}